-- Logs begin at Mon 2021-11-08 15:33:01 UTC, end at Mon 2021-11-08 16:32:57 UTC. -- Nov 08 16:02:44.011300 dv-cinder-816187-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 08 16:02:44.018476 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 08 16:02:44.020455 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 8 16:02:44 2021] *** Nov 08 16:02:44.020455 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 08 16:02:44.020455 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 08 16:02:44.020455 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: nodename: dv-cinder-816187-2-iscsi Nov 08 16:02:44.020455 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: machine: x86_64 Nov 08 16:02:44.020455 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: clock source: unix Nov 08 16:02:44.020455 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: pcre jit disabled Nov 08 16:02:44.020944 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: detected number of CPU cores: 4 Nov 08 16:02:44.020944 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: current working directory: / Nov 08 16:02:44.020944 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: detected binary path: /usr/bin/uwsgi-core Nov 08 16:02:44.020944 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: your processes number limit is 47680 Nov 08 16:02:44.020944 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: your memory page size is 4096 bytes Nov 08 16:02:44.020944 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: detected max file descriptor number: 2048 Nov 08 16:02:44.020944 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: lock engine: pthread robust mutexes Nov 08 16:02:44.020944 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: thunder lock: enabled Nov 08 16:02:44.020944 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 08 16:02:44.020944 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 08 16:02:44.067746 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: Python main interpreter initialized at 0x562fc14e69c0 Nov 08 16:02:44.067746 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: python threads support enabled Nov 08 16:02:44.067746 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: your server socket listen backlog is limited to 100 connections Nov 08 16:02:44.067746 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: your mercy for graceful operations on workers is 90 seconds Nov 08 16:02:44.068140 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: mapped 403077 bytes (393 KB) for 2 cores Nov 08 16:02:44.068215 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: *** Operational MODE: preforking *** Nov 08 16:02:44.068449 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: *** uWSGI is running in multiple interpreter mode *** Nov 08 16:02:44.068449 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: spawned uWSGI master process (pid: 100551) Nov 08 16:02:44.068636 dv-cinder-816187-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 08 16:02:44.070289 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: spawned uWSGI worker 1 (pid: 100552, cores: 1) Nov 08 16:02:44.070289 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: spawned uWSGI worker 2 (pid: 100553, cores: 1) Nov 08 16:02:44.070289 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 08 16:02:45.690578 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 16:02:45.690578 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: from cryptography.utils import int_from_bytes Nov 08 16:02:45.691269 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 16:02:45.691269 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: from cryptography.utils import int_from_bytes Nov 08 16:02:45.694166 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 16:02:45.694166 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: from cryptography.utils import int_from_bytes Nov 08 16:02:45.694650 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 16:02:45.694650 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: from cryptography.utils import int_from_bytes Nov 08 16:02:48.264334 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 08 16:02:48.264850 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 08 16:02:48.265077 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 08 16:02:48.265238 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 08 16:02:48.265608 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 08 16:02:48.265703 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 08 16:02:48.265841 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 08 16:02:48.265996 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 08 16:02:48.266141 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.266322 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.266418 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 08 16:02:48.266589 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 08 16:02:48.266675 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.266932 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.267037 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.267250 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.267350 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.267554 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.267643 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.267869 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.267955 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.268181 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.268275 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.268488 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.268579 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.268738 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.268829 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.269047 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.269143 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.269359 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816187-2-iscsi {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.269446 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.269659 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.269779 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.269980 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.270066 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.270285 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.270378 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816187-2-iscsi {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.270596 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.270699 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.270892 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.270986 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.271196 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.271281 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.271493 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.271586 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.271800 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.271979 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.272119 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.273669 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.273851 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.273966 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.274055 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.274146 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.274232 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.274311 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.274451 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.274542 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.274621 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.274698 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.274831 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.274927 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.275013 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.275139 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.275277 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.275365 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.275594 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.275693 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.275901 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.276034 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816187-2-iscsi {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.276223 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.276344 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.276530 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.276648 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.276922 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816187-2-iscsi {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.277051 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.277235 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.277322 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.277544 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.277636 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.277879 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.277976 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.278235 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.278322 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.278549 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.278644 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.278849 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.278943 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.279166 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.279254 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.279479 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.279565 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.279786 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.279879 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.280096 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.280182 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.280390 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.280476 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.280690 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.280782 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.280989 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.281122 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.281292 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.281373 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.281579 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.281666 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.281894 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.281996 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.282138 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.282231 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.282437 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.282529 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.282749 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.282848 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.283007 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.283092 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.283310 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.283397 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.283596 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.283696 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.283839 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.283933 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.284156 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.284258 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.284459 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.284554 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.284701 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.284787 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.285016 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.285112 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.285327 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.285420 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.285628 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.285743 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.285952 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.286051 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.286252 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.286342 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.286548 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.286633 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.286845 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.287075 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.287164 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.287242 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.287441 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.287544 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.287744 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.287838 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.288040 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.288126 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.288379 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.288466 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.288695 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.288789 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.288995 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.289080 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.289294 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.289380 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.289624 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.289740 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.289951 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.290039 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.290249 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.290348 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.290558 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.290648 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.290869 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.290962 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.291168 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.291259 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.291461 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.291553 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.291759 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.291846 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.292069 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.292161 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.292368 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.292454 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.292665 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.292794 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.292909 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.293005 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.293201 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.293287 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.293501 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.293586 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.293832 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.293944 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.294131 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.294224 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.294427 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.294518 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.294725 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.294819 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.295017 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.295103 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.295313 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.295400 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.295609 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.295704 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.295904 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.295996 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.296198 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.296283 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.296497 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.296584 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.296794 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.296879 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.297091 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.297175 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.297382 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.297468 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.297677 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.297834 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.298004 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.298090 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.298310 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.298398 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.298604 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.298690 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.298902 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.298997 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.299199 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.299294 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.299496 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.299594 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.299800 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.299885 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.300097 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.300184 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.300396 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.300489 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.300706 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.300792 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.301003 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.301089 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.301302 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.301394 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.301611 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.301697 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.301937 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.302025 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.302236 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.302324 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.302547 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.302640 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.302841 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.302933 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.303140 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.303226 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.303451 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.303600 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.303745 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.303895 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.304067 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.304152 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.304365 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.304461 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.304660 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.304746 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.304957 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.305056 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.305255 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.305349 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.305548 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.305634 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.305868 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.305986 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.306162 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.306257 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.306459 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.306546 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.306765 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.306851 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.307063 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.307228 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.307359 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.307453 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.307658 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.307751 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.307969 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.308057 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.308268 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.308353 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.308571 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.308670 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.308887 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:48.308975 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.309217 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.309303 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.309543 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.309636 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.309892 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.309981 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.310205 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.310290 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.310509 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.310608 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.310817 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.310905 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.311136 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.311221 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.311444 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.311536 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.311746 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.311830 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.312053 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.312140 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.312362 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.312459 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.312670 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.312756 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.312976 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.313067 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.313289 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.313375 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.313600 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.313696 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.313931 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.314029 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.314235 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.314338 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.314543 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.314629 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.314854 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.314940 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.315162 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.315256 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.315464 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.315556 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.315785 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.315870 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.316102 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.316197 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.316406 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.316491 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.316724 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.316810 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.317027 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.317122 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.317341 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.317428 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.317644 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.317749 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.317974 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.318063 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.318278 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.318366 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.318584 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.318670 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.318892 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.318981 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.319193 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.319278 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.320050 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.320163 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.320359 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.320671 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.320756 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.320971 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.321176 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.321272 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.321554 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.321645 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.321941 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.322036 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.322239 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.322335 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.322556 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.322643 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.322858 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.322944 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.323165 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.323265 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.323475 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.323563 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.323776 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.323861 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.324080 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.324173 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.324385 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.324472 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.324684 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.324770 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.324989 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.325084 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.325295 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.325382 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.325594 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.325681 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.325930 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.326019 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.326232 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.326323 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.326528 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.326615 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.326833 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.326926 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.327128 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.327213 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.327424 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.327519 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.327730 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.327824 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.328030 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.328122 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.328329 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.328425 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.328632 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.328720 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.328930 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.329017 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.329236 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.329330 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.329539 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.329627 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.329868 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.329956 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.330187 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.330407 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.330548 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.330684 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.330970 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.331107 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.331251 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.331386 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.331524 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.331658 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.331742 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.331821 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.331944 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.332033 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.332242 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.332329 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.332539 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.332633 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.332836 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.332931 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.333184 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.333277 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.333437 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.333524 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.333765 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.333859 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.334058 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.334147 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.334354 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.334449 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.334649 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.334744 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.334950 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.335055 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.335818 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.335920 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.336120 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.336208 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.336417 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.336505 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.336716 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.336813 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.337049 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.337136 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.337346 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.337438 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.337650 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.337826 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.338051 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.338203 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.338340 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.338484 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.338626 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.338761 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.338897 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.339031 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.339193 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.339328 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.339496 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.339634 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.339798 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.339935 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.340103 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.340344 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.340495 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.340630 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.344877 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.345020 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.345158 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.345293 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.345439 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.345574 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.345726 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.345860 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.345996 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.346142 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.346292 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.346435 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.346572 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.346707 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.346842 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.346985 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.347121 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.347257 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.347400 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.347542 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.347678 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.347775 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.347857 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.347935 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.347935 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.348077 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.348077 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.348224 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.348304 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.348382 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.348467 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.348552 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.348632 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.348718 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.352671 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.352779 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.352875 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.352963 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.353052 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.353132 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.353210 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.353288 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.353354 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.353418 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.353491 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.353571 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.353657 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.353755 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.353824 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.353900 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.353988 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.354068 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.354152 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.354225 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.354303 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.354380 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.354466 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.354547 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.354624 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.354701 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.354785 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.354864 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.354951 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.355031 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.355114 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.355199 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.355277 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.355366 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.355452 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.355537 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.355616 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.355693 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.355770 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.355856 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.355935 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.356019 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.356103 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.356182 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.356259 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.356344 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.356422 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.356499 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.356583 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.356661 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.358099 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.358201 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.358282 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.358361 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.358438 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.358516 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.358602 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.358682 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.358759 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.358837 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.358921 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.359006 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.359093 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.359173 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.359251 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.359329 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.359406 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.359483 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.359605 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.359713 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.359797 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.359884 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.359964 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.360040 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.360132 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.360212 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.360289 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.360422 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.360510 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.360598 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.360677 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.360755 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.360831 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.360908 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.360992 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.361148 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.361230 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.361316 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.361402 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.361482 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.361559 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.361644 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.361742 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.361822 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.361888 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.361952 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.362029 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.362117 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.362198 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.362276 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.362361 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.362440 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.362525 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.362605 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.362682 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.362682 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.362820 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.362897 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.362983 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.363069 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.363147 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.363224 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.363300 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.363385 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.363478 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.363560 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.363638 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.363715 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.363792 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.363869 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.363963 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.364045 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.364123 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.364200 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.364277 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.364363 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.364454 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.364539 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.364618 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.364807 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.364977 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.365117 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.365307 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.365425 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.365619 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.365753 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.365964 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.366063 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.366298 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.366397 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.366614 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.366922 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.367007 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.367244 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.367330 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.367551 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.367637 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.367853 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.367951 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.368159 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.368245 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.368459 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.368553 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.368756 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.368854 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.369059 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.369146 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.369357 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.369443 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.369655 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.369765 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.369979 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.370073 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.370282 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.370369 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.370582 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.370743 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.370889 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.371270 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.371440 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.371570 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.371737 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.371883 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.372040 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.372155 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.372330 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.372418 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.372634 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.372722 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.372931 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.373017 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.373244 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.373329 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.373550 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.373702 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.373907 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.374054 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.374188 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.374321 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.374459 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.374595 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.374734 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.374876 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.375040 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.375174 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.375343 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.375476 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.375645 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.375782 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.375946 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.376081 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.376247 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.376389 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.376553 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.376698 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.376879 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.377012 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.377154 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.377289 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.377429 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.377562 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.377744 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.377886 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.378050 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.378194 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.378350 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.378486 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.378630 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.378765 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.378932 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.379076 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.379233 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.379368 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.379534 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.379670 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.379834 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.379982 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.380116 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.380249 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.380420 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.380565 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.380717 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.380860 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.381024 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.381167 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.381326 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.381460 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.381664 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.381823 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.382453 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.382596 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.382731 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.382880 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.383019 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.383151 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.383311 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.383446 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.383615 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.383756 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.383900 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.384034 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.384196 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.384339 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.384496 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.384582 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.384793 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.384880 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.385090 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.385174 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.385390 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.385486 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.385686 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.385806 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.386004 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.386090 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.386308 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.386404 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.386607 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.386699 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.386904 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.386989 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.387196 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.387293 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.387500 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.387587 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.387795 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.387880 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.388088 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.388181 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.388389 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.388476 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.388689 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.388773 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.388990 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.389076 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.389283 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.389367 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.389580 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.389665 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.389899 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.389987 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.390196 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.390283 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.390494 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.390581 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.390796 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.390889 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.391091 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.391177 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.391385 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.391471 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.391681 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.391774 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.391975 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.392060 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.392270 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.392365 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.392571 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.392663 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.392869 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.392955 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.393161 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.393253 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.393457 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.393543 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.393770 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.393860 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.394069 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.394167 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.394389 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.394482 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.394695 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.394782 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.394996 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.395090 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.395297 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.395382 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.395597 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.395684 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.395897 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.395990 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.396201 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.396287 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.396508 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.396601 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.396804 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.396891 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.397110 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.397196 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.397410 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.397497 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.398298 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.398394 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.398600 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.398687 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.398898 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.398991 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.399194 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.399280 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.399503 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.399588 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.399806 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.399892 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.400112 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.400198 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.400414 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.400499 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.400720 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.400816 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.401011 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.401097 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.401314 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.401400 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.401617 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.401734 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.401943 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.402040 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.402245 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.402331 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.402550 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.402648 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.402855 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.402941 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.403164 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.403278 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.403468 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.403566 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.403771 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.403881 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.404073 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.404170 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.404374 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.404460 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.404675 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.404760 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.404977 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.405069 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.405271 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.405356 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.405576 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.405661 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.405903 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.405997 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.406202 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.406297 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.406504 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.406598 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.406802 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.406903 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.407100 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.407193 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.407393 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.407485 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.407713 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.407815 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.408017 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.408112 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.408324 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.408422 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.408627 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.408731 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.408936 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.409030 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.409235 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.409329 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.409538 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.409639 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.409870 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.409995 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.410165 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.410303 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.410568 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.410734 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.410874 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.410961 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.411179 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.411267 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.411481 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.411575 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.411777 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.411869 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.412072 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.412158 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.412374 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.412468 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.412688 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.412813 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.412986 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.413073 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.413308 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.413399 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.413606 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.413693 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.413945 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.414032 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.414250 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.414388 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.414547 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.414689 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.414857 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.415004 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.415160 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.415302 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.415461 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.415621 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.415779 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.415922 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.416082 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.416218 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.416399 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.416536 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.416787 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.416929 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.417100 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.417236 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.417398 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.417532 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.417701 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.417876 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.418011 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.418151 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.418315 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.418461 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.418630 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.418773 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.418945 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.419080 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.419247 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.419382 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.419556 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.419693 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.419853 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.419987 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.420167 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.420303 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.420482 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.420618 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.420788 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.420923 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.421101 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.421235 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.421415 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.421551 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.421733 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.421873 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.422057 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.422200 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.422377 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.422522 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.422687 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.422848 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.422991 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.423126 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.423292 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.423438 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.423597 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.423691 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.423896 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.423983 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.424198 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.424347 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.424516 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.424603 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.424817 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.424904 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.425123 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.425219 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.425428 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.425515 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.425742 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.425834 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.426048 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.426152 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.426347 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.426443 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.426658 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.426743 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.426955 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.427043 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.427264 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.427350 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.427568 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.427659 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.427867 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.427954 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.428171 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.428258 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.428468 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.428553 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.429286 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.429382 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.429593 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.429680 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.429917 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.430008 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.430214 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.430303 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.430515 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.430602 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.430838 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.430931 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.431136 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.431229 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.431453 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.431539 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.431750 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.431844 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.432051 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.432145 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.432354 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.432440 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.432683 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.432778 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.432982 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.433067 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.433296 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.433382 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.433610 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.433732 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.433954 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.434042 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.434255 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.434380 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.434554 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.434649 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.434864 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.434951 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.435164 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.435252 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.435464 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.435552 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.435762 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.435847 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.436066 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.436153 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.436363 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.436460 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.436662 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.436749 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.436960 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.437052 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.437261 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.437348 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.437556 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.437649 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.437886 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.437986 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.438188 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.438273 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.438487 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.438585 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.438886 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.438996 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.439080 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.439158 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.439384 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.439470 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.439684 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.439778 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.439997 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.440082 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.440299 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.440401 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.440601 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.440690 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.440906 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.440993 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.441208 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.441293 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.441527 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.441621 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.441863 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.441954 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.442174 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.442261 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.442486 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.442582 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.442795 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.442882 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.443102 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.443187 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.443409 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.443495 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.443720 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.443810 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.444024 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.444110 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.444333 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.444473 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.445185 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.445274 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.445496 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.445593 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.445843 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.446039 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.446155 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.446365 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.446454 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.446679 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.446766 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.446993 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.447090 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.447306 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.447393 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.447616 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.447859 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.447946 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.448192 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.448278 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.448509 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.448596 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.448811 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.448896 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.449118 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.449247 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.449428 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.449514 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.449763 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.449853 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.450084 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.450175 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.450399 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.450486 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.450709 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.450793 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.451021 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.451116 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.451332 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.451418 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.451642 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.451727 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.451960 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.452054 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.452286 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.452377 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.452588 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.452673 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.452896 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.452984 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.453205 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.453302 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.453512 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.453617 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.453842 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.453940 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.454145 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.454271 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.454452 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.454557 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.454761 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.454856 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.455069 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.455155 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.455368 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.455462 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.455674 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.455761 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.455978 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.456167 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.456289 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.456389 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.456602 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.456688 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.456913 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.457004 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.457220 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.457379 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.457523 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.457609 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.457855 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.457943 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.458180 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.458364 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.458512 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.458674 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.458833 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.459004 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.459145 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.459324 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.459457 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.459640 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.459771 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.459949 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.460285 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.460385 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.460606 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.460692 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.460904 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.460989 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.461205 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.461291 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.461512 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.461598 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.461838 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.461938 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.462140 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.462233 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.462457 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.462549 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.462762 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.462856 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.463061 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.463153 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.463375 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.463464 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.463676 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.463774 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.463977 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.464197 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.464292 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.464536 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.464696 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.464847 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.464940 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.465171 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.465263 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.465475 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.465569 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.465809 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.466035 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.466139 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.466378 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.466474 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.466692 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.466778 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.466988 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.467085 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.467296 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.467381 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.467600 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.467687 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.467899 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.467985 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.468196 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.468290 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.468500 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.468585 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.468799 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.468883 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.469092 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.469185 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.469394 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.469480 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.469692 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.469799 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.470017 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.470119 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.470321 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.470406 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.470620 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.470712 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.470917 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.471011 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.471222 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.471306 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.471516 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.471599 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.471813 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.471906 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.472112 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.472197 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.472410 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.472496 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.472707 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.472792 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.473000 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.473085 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.473302 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.473444 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.473598 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.473684 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.473924 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.474022 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.474224 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.474320 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.474523 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.474608 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.474818 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.474910 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.475124 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.475210 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.475420 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.475505 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.475752 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.475843 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.476053 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.476147 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.476355 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.476439 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.476651 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.476736 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.476960 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.477056 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.477258 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.477350 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.477560 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.477645 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.477909 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.478008 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.478218 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.478428 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.478538 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.478808 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.478901 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.479124 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.479209 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.479459 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.479545 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.479768 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.479865 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.480174 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.480298 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.480386 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.480668 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.480752 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.480983 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.481071 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.481289 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.481375 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.481595 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.481688 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.481926 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.482013 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.482231 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.482317 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.482535 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.482629 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.482838 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.482923 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.483141 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.483226 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.483445 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.484974 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.484974 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.485174 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.485174 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.485317 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.485394 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.485479 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.485565 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.485650 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.485756 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.485837 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.485913 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.486008 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.486088 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.486171 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.486249 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.486326 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.486456 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.486574 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.486698 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.486890 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.487009 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.487207 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.487333 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.487523 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.487644 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.487832 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.487945 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.488140 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.488352 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.488438 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.488659 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.488745 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.488972 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.489066 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.489288 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.489373 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.489594 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.489687 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.489935 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.490037 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.490252 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.490346 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.490558 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.490643 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.490873 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.490972 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.491179 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.491806 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.492046 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.492133 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.492383 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.492469 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.492699 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.492783 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.493011 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.493097 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.493309 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.493393 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.493608 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.493692 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.493932 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.494019 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.494238 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.494333 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.494564 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.494648 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.494873 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.495027 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.495196 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.495285 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.495495 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.495580 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.495799 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.495894 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.496356 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.496442 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.496671 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.496766 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.496982 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.497080 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.497287 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.497372 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.497591 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.497676 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.497932 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.498031 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.498235 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.498321 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.498543 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.498629 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.498849 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.498935 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.499154 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.499240 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.499459 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.499551 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.499760 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.499846 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.500080 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.500165 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.500385 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.500470 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.500689 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.500774 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.501001 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.501085 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.501309 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.501403 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.501618 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.501731 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.501955 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.502049 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.502262 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.502356 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.502566 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.502651 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.502876 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.502960 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.503186 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.503280 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.503492 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.503578 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.503808 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.503918 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.504108 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.504193 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.504415 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.504506 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.504730 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.504821 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.505045 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.505131 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.505356 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.505450 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.505666 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.505794 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.506008 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.506102 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.506317 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.506401 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.506638 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.506722 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.507007 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.507595 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.507818 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.507904 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.508126 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.508224 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.508425 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.508511 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.508662 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 08 16:02:48.508748 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.509089 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.509417 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.509751 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.510067 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.510373 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:48.510616 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 08 16:02:48.531066 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_db.sqlalchemy.engines [None req-9833cfd9-0f6a-4970-8349-393cdd629f0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 16:02:48.532094 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG oslo_db.sqlalchemy.engines [None req-cd6b8d4c-c382-4542-bf5f-4e3279417bf3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 16:02:48.692678 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.context [None req-9833cfd9-0f6a-4970-8349-393cdd629f0b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f1b83286-04a5-43a5-b4a1-4bd0edc3473b(cell1) {{(pid=100553) load_cells /opt/stack/nova/nova/context.py:464}} Nov 08 16:02:48.695252 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.context [None req-cd6b8d4c-c382-4542-bf5f-4e3279417bf3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f1b83286-04a5-43a5-b4a1-4bd0edc3473b(cell1) {{(pid=100552) load_cells /opt/stack/nova/nova/context.py:464}} Nov 08 16:02:48.696802 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-9833cfd9-0f6a-4970-8349-393cdd629f0b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:02:48.698703 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-9833cfd9-0f6a-4970-8349-393cdd629f0b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:02:48.699378 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG oslo_concurrency.lockutils [None req-cd6b8d4c-c382-4542-bf5f-4e3279417bf3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:02:48.699481 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-9833cfd9-0f6a-4970-8349-393cdd629f0b None None] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:02:48.701138 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG oslo_concurrency.lockutils [None req-cd6b8d4c-c382-4542-bf5f-4e3279417bf3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:02:48.701384 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-9833cfd9-0f6a-4970-8349-393cdd629f0b None None] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:02:48.702007 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG oslo_concurrency.lockutils [None req-cd6b8d4c-c382-4542-bf5f-4e3279417bf3 None None] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:02:48.703927 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG oslo_concurrency.lockutils [None req-cd6b8d4c-c382-4542-bf5f-4e3279417bf3 None None] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:02:48.714168 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_db.sqlalchemy.engines [None req-9833cfd9-0f6a-4970-8349-393cdd629f0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 16:02:48.714989 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_db.sqlalchemy.engines [None req-9833cfd9-0f6a-4970-8349-393cdd629f0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 16:02:48.718168 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG oslo_db.sqlalchemy.engines [None req-cd6b8d4c-c382-4542-bf5f-4e3279417bf3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 16:02:48.720173 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG oslo_db.sqlalchemy.engines [None req-cd6b8d4c-c382-4542-bf5f-4e3279417bf3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 16:02:48.980796 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_db.sqlalchemy.engines [None req-9833cfd9-0f6a-4970-8349-393cdd629f0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 16:02:48.983538 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG oslo_db.sqlalchemy.engines [None req-cd6b8d4c-c382-4542-bf5f-4e3279417bf3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 16:02:49.318898 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: WARNING keystonemiddleware.auth_token [None req-9833cfd9-0f6a-4970-8349-393cdd629f0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 08 16:02:49.320801 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: WARNING keystonemiddleware.auth_token [None req-cd6b8d4c-c382-4542-bf5f-4e3279417bf3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 08 16:02:49.326829 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: WARNING keystonemiddleware.auth_token [None req-9833cfd9-0f6a-4970-8349-393cdd629f0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 08 16:02:49.328149 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: WARNING keystonemiddleware.auth_token [None req-cd6b8d4c-c382-4542-bf5f-4e3279417bf3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 08 16:02:49.671038 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: WARNING keystonemiddleware.auth_token [None req-9833cfd9-0f6a-4970-8349-393cdd629f0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 08 16:02:49.673223 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: WARNING keystonemiddleware.auth_token [None req-cd6b8d4c-c382-4542-bf5f-4e3279417bf3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 08 16:02:49.676972 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: WARNING keystonemiddleware.auth_token [None req-9833cfd9-0f6a-4970-8349-393cdd629f0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 08 16:02:49.678363 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: WARNING keystonemiddleware.auth_token [None req-cd6b8d4c-c382-4542-bf5f-4e3279417bf3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 08 16:02:49.682253 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562fc14e69c0 pid: 100553 (default app) Nov 08 16:02:49.683696 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562fc14e69c0 pid: 100552 (default app) Nov 08 16:02:49.684288 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-9833cfd9-0f6a-4970-8349-393cdd629f0b None None] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:02:49.685465 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-9833cfd9-0f6a-4970-8349-393cdd629f0b None None] 10.222.0.37 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001728 Nov 08 16:02:49.685902 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 1/1] 10.222.0.37 () {50 vars in 788 bytes} [Mon Nov 8 16:02:49 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:04:09.808685 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-cd6b8d4c-c382-4542-bf5f-4e3279417bf3 None None] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:04:09.809922 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-cd6b8d4c-c382-4542-bf5f-4e3279417bf3 None None] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001959 Nov 08 16:04:09.814186 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 1/2] 10.222.0.37 () {54 vars in 930 bytes} [Mon Nov 8 16:04:09 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:04:10.225499 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-a9857ae1-0349-4399-855d-1bd5e80ad694 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:04:10.255353 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-a9857ae1-0349-4399-855d-1bd5e80ad694 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.438325 Nov 08 16:04:10.256117 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 2/3] 10.222.0.37 () {60 vars in 1291 bytes} [Mon Nov 8 16:04:09 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:04:12.549584 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-cd6b8d4c-c382-4542-bf5f-4e3279417bf3 None None] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:04:12.550616 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-cd6b8d4c-c382-4542-bf5f-4e3279417bf3 None None] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001973 Nov 08 16:04:12.551018 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 2/4] 10.222.0.37 () {54 vars in 930 bytes} [Mon Nov 8 16:04:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:04:12.613045 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-d44a95e0-8d16-4c50-a9c9-06f5c902bd49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1"}} {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:12.631648 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:04:12.631648 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: warnings.warn(msg) Nov 08 16:04:12.660051 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-d44a95e0-8d16-4c50-a9c9-06f5c902bd49 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102393 Nov 08 16:04:12.660819 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 3/5] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Nov 8 16:04:12 2021] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:04:12.879089 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-21296b03-9e14-4b48-91fd-f5c4333256f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:12.881442 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:04:12.881442 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: warnings.warn(msg) Nov 08 16:04:12.936470 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-21296b03-9e14-4b48-91fd-f5c4333256f5 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.267133 Nov 08 16:04:12.942902 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 3/6] 10.222.0.37 () {64 vars in 1335 bytes} [Mon Nov 8 16:04:12 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:04:15.244492 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-d44a95e0-8d16-4c50-a9c9-06f5c902bd49 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:04:15.245503 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-d44a95e0-8d16-4c50-a9c9-06f5c902bd49 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001709 Nov 08 16:04:15.246240 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 4/7] 10.222.0.37 () {54 vars in 930 bytes} [Mon Nov 8 16:04:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:04:15.364425 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-35761a81-e61d-4a55-99d2-9723c8875c7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "name": "ds512M"}} {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:15.383720 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:04:15.383720 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: warnings.warn(msg) Nov 08 16:04:15.404040 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-35761a81-e61d-4a55-99d2-9723c8875c7d admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150873 Nov 08 16:04:15.405071 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 4/8] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Nov 8 16:04:15 2021] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:04:15.418582 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-ca79d0b9-63ec-45a4-83e5-683e27964deb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:15.420382 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:04:15.420382 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: warnings.warn(msg) Nov 08 16:04:15.457139 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-ca79d0b9-63ec-45a4-83e5-683e27964deb admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043113 Nov 08 16:04:15.458084 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 5/9] 10.222.0.37 () {64 vars in 1335 bytes} [Mon Nov 8 16:04:15 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:04:17.766984 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-35761a81-e61d-4a55-99d2-9723c8875c7d admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:04:17.769581 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-35761a81-e61d-4a55-99d2-9723c8875c7d admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002994 Nov 08 16:04:17.770251 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 5/10] 10.222.0.37 () {54 vars in 930 bytes} [Mon Nov 8 16:04:17 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:04:17.836772 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-6ca47e9c-6c7d-4a44-a95f-118b54ba8033 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "vcpus": 1, "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 1024}} {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:17.857550 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-6ca47e9c-6c7d-4a44-a95f-118b54ba8033 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079764 Nov 08 16:04:17.858358 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 6/11] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Nov 8 16:04:17 2021] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:04:17.873488 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-b03f6f87-8013-4063-8edd-c0aa312c29dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:17.902469 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-b03f6f87-8013-4063-8edd-c0aa312c29dd admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034784 Nov 08 16:04:17.905755 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 6/12] 10.222.0.37 () {64 vars in 1335 bytes} [Mon Nov 8 16:04:17 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:04:20.205535 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-6ca47e9c-6c7d-4a44-a95f-118b54ba8033 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:04:20.206617 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-6ca47e9c-6c7d-4a44-a95f-118b54ba8033 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001686 Nov 08 16:04:20.207120 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 7/13] 10.222.0.37 () {54 vars in 930 bytes} [Mon Nov 8 16:04:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:04:20.265113 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-3d96996b-7c50-40c9-b30c-56a21df810be admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2}} {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:20.282376 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-3d96996b-7c50-40c9-b30c-56a21df810be admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068976 Nov 08 16:04:20.283407 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 7/14] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Nov 8 16:04:20 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:04:20.295444 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-2d233141-1151-48db-879d-eb74d0f1b772 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:20.316995 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-2d233141-1151-48db-879d-eb74d0f1b772 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025101 Nov 08 16:04:20.317532 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 8/15] 10.222.0.37 () {64 vars in 1335 bytes} [Mon Nov 8 16:04:20 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:04:22.609814 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-3d96996b-7c50-40c9-b30c-56a21df810be admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:04:22.610862 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-3d96996b-7c50-40c9-b30c-56a21df810be admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Nov 08 16:04:22.611776 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 8/16] 10.222.0.37 () {54 vars in 930 bytes} [Mon Nov 8 16:04:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:04:22.674142 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-d41a6906-dc4e-4990-b092-a64a193ad5a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "vcpus": 4}} {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:22.693261 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-d41a6906-dc4e-4990-b092-a64a193ad5a8 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074921 Nov 08 16:04:22.697747 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 9/17] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Nov 8 16:04:22 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:04:22.706374 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-b35085e0-4d8a-405d-8f5f-52bedb4a64be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:22.732106 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-b35085e0-4d8a-405d-8f5f-52bedb4a64be admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029636 Nov 08 16:04:22.732686 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 9/18] 10.222.0.37 () {64 vars in 1335 bytes} [Mon Nov 8 16:04:22 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:04:25.059925 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-d41a6906-dc4e-4990-b092-a64a193ad5a8 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:04:25.061034 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-d41a6906-dc4e-4990-b092-a64a193ad5a8 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Nov 08 16:04:25.061431 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 10/19] 10.222.0.37 () {54 vars in 930 bytes} [Mon Nov 8 16:04:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:04:25.121649 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-1a412bd6-fe18-4273-8bea-f39607616840 admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:04:25.147091 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-1a412bd6-fe18-4273-8bea-f39607616840 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078889 Nov 08 16:04:25.147695 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 10/20] 10.222.0.37 () {60 vars in 1291 bytes} [Mon Nov 8 16:04:25 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:04:27.495109 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-d41a6906-dc4e-4990-b092-a64a193ad5a8 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:04:27.496106 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-d41a6906-dc4e-4990-b092-a64a193ad5a8 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Nov 08 16:04:27.496509 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 11/21] 10.222.0.37 () {54 vars in 930 bytes} [Mon Nov 8 16:04:27 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:04:27.554835 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-9cbc78ff-56b1-40fa-b434-961e1e9e7b8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "rxtx_factor": 1.0}} {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:27.573811 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-9cbc78ff-56b1-40fa-b434-961e1e9e7b8c admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070788 Nov 08 16:04:27.574358 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 11/22] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Nov 8 16:04:27 2021] POST /compute/v2.1/flavors => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:04:27.587175 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-a9d82a9c-9351-4d20-883d-4ae6c306ac03 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:27.610350 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-a9d82a9c-9351-4d20-883d-4ae6c306ac03 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026749 Nov 08 16:04:27.610965 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 12/23] 10.222.0.37 () {64 vars in 1332 bytes} [Mon Nov 8 16:04:27 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:04:29.942390 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-9cbc78ff-56b1-40fa-b434-961e1e9e7b8c admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:04:29.943721 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-9cbc78ff-56b1-40fa-b434-961e1e9e7b8c admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001811 Nov 08 16:04:29.944390 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 12/24] 10.222.0.37 () {54 vars in 930 bytes} [Mon Nov 8 16:04:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:04:30.001534 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-516ca405-ba0a-49d1-bc5b-a1deaec2a073 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2"}} {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:30.019256 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-516ca405-ba0a-49d1-bc5b-a1deaec2a073 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.068690 Nov 08 16:04:30.019799 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 13/25] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Nov 8 16:04:29 2021] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:04:30.032183 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-bccb45b6-4f07-4cd8-91fd-0a95034fee17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:30.056454 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-bccb45b6-4f07-4cd8-91fd-0a95034fee17 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027905 Nov 08 16:04:30.057170 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 13/26] 10.222.0.37 () {64 vars in 1332 bytes} [Mon Nov 8 16:04:30 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:04:32.752964 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-516ca405-ba0a-49d1-bc5b-a1deaec2a073 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:04:32.754041 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-516ca405-ba0a-49d1-bc5b-a1deaec2a073 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Nov 08 16:04:32.754458 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 14/27] 10.222.0.37 () {54 vars in 930 bytes} [Mon Nov 8 16:04:32 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:04:32.813785 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-68094894-3e31-43ed-b00b-64f43f5350a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "name": "m1.medium", "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 40, "vcpus": 2}} {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:32.831901 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-68094894-3e31-43ed-b00b-64f43f5350a3 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070950 Nov 08 16:04:32.832680 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 14/28] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Nov 8 16:04:32 2021] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:04:32.845161 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-61139d8f-f34e-4c8a-a9c0-5eea14f45f2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:32.869116 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-61139d8f-f34e-4c8a-a9c0-5eea14f45f2c admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027727 Nov 08 16:04:32.869688 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 15/29] 10.222.0.37 () {64 vars in 1332 bytes} [Mon Nov 8 16:04:32 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:04:35.195349 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-68094894-3e31-43ed-b00b-64f43f5350a3 admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:04:35.196485 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-68094894-3e31-43ed-b00b-64f43f5350a3 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Nov 08 16:04:35.196886 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 15/30] 10.222.0.37 () {54 vars in 930 bytes} [Mon Nov 8 16:04:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:04:35.255765 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-f0b8dbb9-6f97-4bbb-9869-fd6d003db30e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "ram": 8192, "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:35.273253 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-f0b8dbb9-6f97-4bbb-9869-fd6d003db30e admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069946 Nov 08 16:04:35.273819 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 16/31] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Nov 8 16:04:35 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:04:35.286286 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-66e572c7-363b-4276-a37d-1efae239bc9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:35.309725 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-66e572c7-363b-4276-a37d-1efae239bc9d admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027525 Nov 08 16:04:35.310310 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 16/32] 10.222.0.37 () {64 vars in 1332 bytes} [Mon Nov 8 16:04:35 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:04:37.620016 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-f0b8dbb9-6f97-4bbb-9869-fd6d003db30e admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:04:37.621021 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-f0b8dbb9-6f97-4bbb-9869-fd6d003db30e admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Nov 08 16:04:37.621414 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 17/33] 10.222.0.37 () {54 vars in 930 bytes} [Mon Nov 8 16:04:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:04:37.687843 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-87d818bc-8bf1-45b4-914b-e22ff5948b27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "vcpus": 8, "id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:37.709756 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-87d818bc-8bf1-45b4-914b-e22ff5948b27 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080574 Nov 08 16:04:37.709756 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 17/34] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Nov 8 16:04:37 2021] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:04:37.723469 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-9c81e6d4-1b9d-4136-bdd7-373cdb5ab9bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:04:37.750955 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-9c81e6d4-1b9d-4136-bdd7-373cdb5ab9bc admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032026 Nov 08 16:04:37.751724 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 18/35] 10.222.0.37 () {64 vars in 1332 bytes} [Mon Nov 8 16:04:37 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:05:19.009463 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-87d818bc-8bf1-45b4-914b-e22ff5948b27 admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:19.010491 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-87d818bc-8bf1-45b4-914b-e22ff5948b27 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Nov 08 16:05:19.010889 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 18/36] 10.222.0.37 () {54 vars in 930 bytes} [Mon Nov 8 16:05:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:05:19.068504 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-4c29ada8-d44e-40fd-98bd-5e7bcd5be3e5 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:19.085376 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-4c29ada8-d44e-40fd-98bd-5e7bcd5be3e5 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067563 Nov 08 16:05:19.085940 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 19/37] 10.222.0.37 () {60 vars in 1291 bytes} [Mon Nov 8 16:05:19 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:05:20.594624 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-87d818bc-8bf1-45b4-914b-e22ff5948b27 admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:20.595622 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-87d818bc-8bf1-45b4-914b-e22ff5948b27 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001974 Nov 08 16:05:20.596020 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 19/38] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Nov 8 16:05:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:05:20.784751 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-66817655-99d8-4385-b327-19843730b4d5 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:20.790092 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.wsgi [None req-66817655-99d8-4385-b327-19843730b4d5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 08 16:05:20.790757 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-66817655-99d8-4385-b327-19843730b4d5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:05:20.791535 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-66817655-99d8-4385-b327-19843730b4d5 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058088 Nov 08 16:05:20.792035 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 20/39] 10.222.0.37 () {60 vars in 1190 bytes} [Mon Nov 8 16:05:20 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 08 16:05:20.801893 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-0724f691-f973-4b74-8d6e-a2d561dd933f admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:20.821832 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-0724f691-f973-4b74-8d6e-a2d561dd933f admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023360 Nov 08 16:05:20.822322 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 20/40] 10.222.0.37 () {60 vars in 1210 bytes} [Mon Nov 8 16:05:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:05:20.832744 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-4b7a5e04-5512-4ba7-b28b-ccdd628960de admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:20.853517 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-4b7a5e04-5512-4ba7-b28b-ccdd628960de admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024213 Nov 08 16:05:20.854064 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 21/41] 10.222.0.37 () {60 vars in 1210 bytes} [Mon Nov 8 16:05:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:05:20.863644 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-abfbe902-d2ef-4224-b036-a76455c57338 admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:20.868865 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.wsgi [None req-abfbe902-d2ef-4224-b036-a76455c57338 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 08 16:05:20.869689 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-abfbe902-d2ef-4224-b036-a76455c57338 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:05:20.870497 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-abfbe902-d2ef-4224-b036-a76455c57338 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010305 Nov 08 16:05:20.870982 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 21/42] 10.222.0.37 () {60 vars in 1190 bytes} [Mon Nov 8 16:05:20 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 08 16:05:22.268886 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-4b7a5e04-5512-4ba7-b28b-ccdd628960de admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:22.269917 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-4b7a5e04-5512-4ba7-b28b-ccdd628960de admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Nov 08 16:05:22.270324 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 22/43] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Nov 8 16:05:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:05:22.457334 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-aa256d83-b096-4bd3-9638-004684f4182a admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:22.462922 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.wsgi [None req-aa256d83-b096-4bd3-9638-004684f4182a admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 08 16:05:22.463494 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-aa256d83-b096-4bd3-9638-004684f4182a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:05:22.464288 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-aa256d83-b096-4bd3-9638-004684f4182a admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.056775 Nov 08 16:05:22.464780 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 22/44] 10.222.0.37 () {60 vars in 1190 bytes} [Mon Nov 8 16:05:22 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 08 16:05:22.474914 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-93c3ba17-3b8b-4e59-bd66-de541b47f4fb admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:22.487969 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-93c3ba17-3b8b-4e59-bd66-de541b47f4fb admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016552 Nov 08 16:05:22.488493 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 23/45] 10.222.0.37 () {60 vars in 1210 bytes} [Mon Nov 8 16:05:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:05:22.498081 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-bff2bf5b-08ca-4303-b758-d28b42ab153f admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:22.511117 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-bff2bf5b-08ca-4303-b758-d28b42ab153f admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016564 Nov 08 16:05:22.511630 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 23/46] 10.222.0.37 () {60 vars in 1210 bytes} [Mon Nov 8 16:05:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:05:22.521351 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-d46827ef-661c-4dd8-962f-4b03c758bcfa admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:22.526274 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.wsgi [None req-d46827ef-661c-4dd8-962f-4b03c758bcfa admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 08 16:05:22.526826 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-d46827ef-661c-4dd8-962f-4b03c758bcfa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:05:22.527585 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-d46827ef-661c-4dd8-962f-4b03c758bcfa admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009650 Nov 08 16:05:22.528057 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 24/47] 10.222.0.37 () {60 vars in 1190 bytes} [Mon Nov 8 16:05:22 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 08 16:05:23.934998 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-bff2bf5b-08ca-4303-b758-d28b42ab153f admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:23.936017 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-bff2bf5b-08ca-4303-b758-d28b42ab153f admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Nov 08 16:05:23.936404 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 24/48] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Nov 8 16:05:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:05:24.127017 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-4bac0d2f-ed95-4fb7-a80e-f8df72d269c7 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:24.132067 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.wsgi [None req-4bac0d2f-ed95-4fb7-a80e-f8df72d269c7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 08 16:05:24.132623 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-4bac0d2f-ed95-4fb7-a80e-f8df72d269c7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:05:24.133431 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-4bac0d2f-ed95-4fb7-a80e-f8df72d269c7 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057229 Nov 08 16:05:24.133974 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 25/49] 10.222.0.37 () {60 vars in 1193 bytes} [Mon Nov 8 16:05:24 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 08 16:05:24.144164 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-8dc15bd3-d008-486f-8f06-376c8c7abf6d admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:24.157136 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-8dc15bd3-d008-486f-8f06-376c8c7abf6d admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017056 Nov 08 16:05:24.157651 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 25/50] 10.222.0.37 () {60 vars in 1210 bytes} [Mon Nov 8 16:05:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:05:24.167521 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-ee752d36-3a70-4172-b4db-eb111e3bad29 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:24.180077 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-ee752d36-3a70-4172-b4db-eb111e3bad29 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016337 Nov 08 16:05:24.180590 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 26/51] 10.222.0.37 () {60 vars in 1210 bytes} [Mon Nov 8 16:05:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:05:24.190232 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-982b9e3f-6713-4c15-b9e7-6d6875796c48 admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:24.195092 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.wsgi [None req-982b9e3f-6713-4c15-b9e7-6d6875796c48 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 08 16:05:24.195632 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-982b9e3f-6713-4c15-b9e7-6d6875796c48 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:05:24.196384 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-982b9e3f-6713-4c15-b9e7-6d6875796c48 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009995 Nov 08 16:05:24.196860 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 26/52] 10.222.0.37 () {60 vars in 1193 bytes} [Mon Nov 8 16:05:24 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 08 16:05:25.581356 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-ee752d36-3a70-4172-b4db-eb111e3bad29 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:25.582377 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-ee752d36-3a70-4172-b4db-eb111e3bad29 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Nov 08 16:05:25.582770 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 27/53] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Nov 8 16:05:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:05:25.775298 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-9e46dea2-3ec1-410f-a9fa-f20dfae95dec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:05:25.792936 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-9e46dea2-3ec1-410f-a9fa-f20dfae95dec admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069395 Nov 08 16:05:25.793409 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 27/54] 10.222.0.37 () {64 vars in 1235 bytes} [Mon Nov 8 16:05:25 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:05:27.207793 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-ee752d36-3a70-4172-b4db-eb111e3bad29 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:27.208780 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-ee752d36-3a70-4172-b4db-eb111e3bad29 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001385 Nov 08 16:05:27.209165 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 28/55] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Nov 8 16:05:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:05:27.398866 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-b62fb449-e8c1-4182-8095-c6bf3cda4217 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:05:27.415459 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-b62fb449-e8c1-4182-8095-c6bf3cda4217 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068110 Nov 08 16:05:27.415997 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 28/56] 10.222.0.37 () {64 vars in 1235 bytes} [Mon Nov 8 16:05:27 2021] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:05:28.801667 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-ee752d36-3a70-4172-b4db-eb111e3bad29 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:28.802732 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-ee752d36-3a70-4172-b4db-eb111e3bad29 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Nov 08 16:05:28.803137 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 29/57] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Nov 8 16:05:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:05:28.993468 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-09c9433e-90c4-4397-8893-9fb5043aa8a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:05:29.011446 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-09c9433e-90c4-4397-8893-9fb5043aa8a4 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068437 Nov 08 16:05:29.011919 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 29/58] 10.222.0.37 () {64 vars in 1235 bytes} [Mon Nov 8 16:05:28 2021] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:05:30.405218 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-ee752d36-3a70-4172-b4db-eb111e3bad29 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:30.406240 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-ee752d36-3a70-4172-b4db-eb111e3bad29 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Nov 08 16:05:30.406658 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 30/59] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Nov 8 16:05:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:05:30.593968 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-6a01517a-7b8e-4d29-bcba-59e5d7001f20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:05:30.611497 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-6a01517a-7b8e-4d29-bcba-59e5d7001f20 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067424 Nov 08 16:05:30.612037 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 30/60] 10.222.0.37 () {64 vars in 1235 bytes} [Mon Nov 8 16:05:30 2021] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:05:32.013639 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-ee752d36-3a70-4172-b4db-eb111e3bad29 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:32.014670 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-ee752d36-3a70-4172-b4db-eb111e3bad29 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Nov 08 16:05:32.015090 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 31/61] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Nov 8 16:05:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:05:32.203293 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-e67dc56a-ca6d-423b-aaaa-5ab0e9180756 admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:05:32.222164 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-e67dc56a-ca6d-423b-aaaa-5ab0e9180756 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069056 Nov 08 16:05:32.222637 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 31/62] 10.222.0.37 () {60 vars in 1202 bytes} [Mon Nov 8 16:05:32 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:06:17.995183 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-ee752d36-3a70-4172-b4db-eb111e3bad29 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:06:17.996348 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-ee752d36-3a70-4172-b4db-eb111e3bad29 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Nov 08 16:06:17.996744 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 32/63] 10.222.0.37 () {54 vars in 930 bytes} [Mon Nov 8 16:06:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:06:18.053619 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-f918ce2c-d74f-42f9-8cd4-d3c64776b87f admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:06:18.072658 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-f918ce2c-d74f-42f9-8cd4-d3c64776b87f admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.068952 Nov 08 16:06:18.073182 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 32/64] 10.222.0.37 () {60 vars in 1291 bytes} [Mon Nov 8 16:06:18 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:06:18.095641 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-7e07eaa3-1789-4044-8a89-7bee062d5ec7 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:06:18.103218 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-7e07eaa3-1789-4044-8a89-7bee062d5ec7 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011637 Nov 08 16:06:18.103732 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 33/65] 10.222.0.37 () {60 vars in 1282 bytes} [Mon Nov 8 16:06:18 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:06:18.115926 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-9394c4ad-cfea-4fbe-99fe-9c8147dae322 admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:06:18.123707 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-9394c4ad-cfea-4fbe-99fe-9c8147dae322 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011302 Nov 08 16:06:18.124215 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 33/66] 10.222.0.37 () {60 vars in 1285 bytes} [Mon Nov 8 16:06:18 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:06:18.135866 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-40d1f0cc-6ea9-43b9-a47e-7a4b1c619903 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:06:18.143201 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-40d1f0cc-6ea9-43b9-a47e-7a4b1c619903 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010814 Nov 08 16:06:18.143721 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 34/67] 10.222.0.37 () {60 vars in 1285 bytes} [Mon Nov 8 16:06:18 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:06:18.155274 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-02e615c0-4626-4b54-8e6b-d97be7184a99 admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:06:18.163157 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-02e615c0-4626-4b54-8e6b-d97be7184a99 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011651 Nov 08 16:06:18.163669 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 34/68] 10.222.0.37 () {60 vars in 1282 bytes} [Mon Nov 8 16:06:18 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:07:44.229879 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-9bcb93ac-54ca-4c1f-843c-11de11208768 tempest-verify_tempest_config-825370562 tempest-verify_tempest_config-825370562-project] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:07:44.231873 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-9bcb93ac-54ca-4c1f-843c-11de11208768 tempest-verify_tempest_config-825370562 tempest-verify_tempest_config-825370562-project] 10.222.0.37 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105743 Nov 08 16:07:44.232410 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 35/69] 10.222.0.37 () {58 vars in 1133 bytes} [Mon Nov 8 16:07:44 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:09:10.336538 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-02e615c0-4626-4b54-8e6b-d97be7184a99 admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:09:10.337482 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-02e615c0-4626-4b54-8e6b-d97be7184a99 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Nov 08 16:09:10.337909 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 35/70] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Nov 8 16:09:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:09:10.590420 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-b0c8f433-029f-460d-baa8-e340b8fdafe9 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:09:10.591499 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:09:10.591499 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: warnings.warn(msg) Nov 08 16:09:10.593006 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-b0c8f433-029f-460d-baa8-e340b8fdafe9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:09:10.593431 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-b0c8f433-029f-460d-baa8-e340b8fdafe9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:09:10.594316 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-b0c8f433-029f-460d-baa8-e340b8fdafe9 admin admin] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:09:10.594730 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-b0c8f433-029f-460d-baa8-e340b8fdafe9 admin admin] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:09:10.626720 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-b0c8f433-029f-460d-baa8-e340b8fdafe9 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.147907 Nov 08 16:09:10.627258 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 36/71] 10.222.0.37 () {60 vars in 1193 bytes} [Mon Nov 8 16:09:10 2021] GET /compute/v2.1/os-services => generated 791 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:09:12.037821 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-02e615c0-4626-4b54-8e6b-d97be7184a99 admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:09:12.038814 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-02e615c0-4626-4b54-8e6b-d97be7184a99 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Nov 08 16:09:12.039201 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 36/72] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Nov 8 16:09:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:09:12.232182 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-12908817-71f0-4a24-a7a0-e037e8dc7499 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:09:12.233333 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:09:12.233333 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: warnings.warn(msg) Nov 08 16:09:12.234958 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-12908817-71f0-4a24-a7a0-e037e8dc7499 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:09:12.235390 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-12908817-71f0-4a24-a7a0-e037e8dc7499 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:09:12.236174 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-12908817-71f0-4a24-a7a0-e037e8dc7499 admin admin] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:09:12.236599 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-12908817-71f0-4a24-a7a0-e037e8dc7499 admin admin] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:09:12.255637 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-12908817-71f0-4a24-a7a0-e037e8dc7499 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073697 Nov 08 16:09:12.256182 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 37/73] 10.222.0.37 () {60 vars in 1193 bytes} [Mon Nov 8 16:09:12 2021] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:09:24.081457 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-02e615c0-4626-4b54-8e6b-d97be7184a99 admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:09:24.082487 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-02e615c0-4626-4b54-8e6b-d97be7184a99 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Nov 08 16:09:24.082885 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 37/74] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Nov 8 16:09:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:09:24.276278 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-f6f3c955-4dd6-42a1-a012-72e172e30c76 admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:09:24.277975 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:09:24.277975 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: warnings.warn(msg) Nov 08 16:09:24.279480 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-f6f3c955-4dd6-42a1-a012-72e172e30c76 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:09:24.279913 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-f6f3c955-4dd6-42a1-a012-72e172e30c76 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:09:24.280728 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-f6f3c955-4dd6-42a1-a012-72e172e30c76 admin admin] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:09:24.281150 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-f6f3c955-4dd6-42a1-a012-72e172e30c76 admin admin] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:09:24.305133 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-f6f3c955-4dd6-42a1-a012-72e172e30c76 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079707 Nov 08 16:09:24.305664 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 38/75] 10.222.0.37 () {60 vars in 1193 bytes} [Mon Nov 8 16:09:24 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:09:25.726310 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: DEBUG nova.api.openstack.wsgi [None req-02e615c0-4626-4b54-8e6b-d97be7184a99 admin admin] Calling method '>' {{(pid=100552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:09:25.727338 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: INFO nova.api.openstack.requestlog [None req-02e615c0-4626-4b54-8e6b-d97be7184a99 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Nov 08 16:09:25.727735 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: [pid: 100552|app: 0|req: 38/76] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Nov 8 16:09:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:09:25.921755 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG nova.api.openstack.wsgi [None req-c8792cc5-84e2-4a54-b930-783852b20fca admin admin] Calling method '>' {{(pid=100553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:09:25.922926 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:09:25.922926 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: warnings.warn(msg) Nov 08 16:09:25.924438 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-c8792cc5-84e2-4a54-b930-783852b20fca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:09:25.924901 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-c8792cc5-84e2-4a54-b930-783852b20fca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:09:25.925769 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-c8792cc5-84e2-4a54-b930-783852b20fca admin admin] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:09:25.926244 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: DEBUG oslo_concurrency.lockutils [None req-c8792cc5-84e2-4a54-b930-783852b20fca admin admin] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:09:25.947390 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: INFO nova.api.openstack.requestlog [None req-c8792cc5-84e2-4a54-b930-783852b20fca admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077233 Nov 08 16:09:25.947874 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: [pid: 100553|app: 0|req: 39/77] 10.222.0.37 () {60 vars in 1193 bytes} [Mon Nov 8 16:09:25 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:10:22.722734 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: Mon Nov 8 16:10:22 2021 - graceful shutdown triggered... Nov 08 16:10:22.722872 dv-cinder-816187-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 08 16:10:22.723792 dv-cinder-816187-2-iscsi devstack@n-api.service[100552]: Gracefully killing worker 1 (pid: 100552)... Nov 08 16:10:22.724231 dv-cinder-816187-2-iscsi devstack@n-api.service[100553]: Gracefully killing worker 2 (pid: 100553)... Nov 08 16:10:23.724170 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: worker 1 buried after 1 seconds Nov 08 16:10:23.724725 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: worker 2 buried after 1 seconds Nov 08 16:10:23.724725 dv-cinder-816187-2-iscsi devstack@n-api.service[100551]: goodbye to uWSGI. Nov 08 16:10:23.725676 dv-cinder-816187-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 08 16:10:23.726248 dv-cinder-816187-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 08 16:10:23.729001 dv-cinder-816187-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 08 16:10:23.740626 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 08 16:10:23.742656 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 8 16:10:23 2021] *** Nov 08 16:10:23.742656 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 08 16:10:23.742656 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 08 16:10:23.742656 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: nodename: dv-cinder-816187-2-iscsi Nov 08 16:10:23.742656 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: machine: x86_64 Nov 08 16:10:23.742656 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: clock source: unix Nov 08 16:10:23.742656 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: pcre jit disabled Nov 08 16:10:23.742656 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: detected number of CPU cores: 4 Nov 08 16:10:23.742656 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: current working directory: / Nov 08 16:10:23.742656 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: detected binary path: /usr/bin/uwsgi-core Nov 08 16:10:23.742656 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: your processes number limit is 47680 Nov 08 16:10:23.743471 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: your memory page size is 4096 bytes Nov 08 16:10:23.743471 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: detected max file descriptor number: 2048 Nov 08 16:10:23.743471 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: lock engine: pthread robust mutexes Nov 08 16:10:23.743471 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: thunder lock: enabled Nov 08 16:10:23.743471 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 08 16:10:23.743471 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 08 16:10:23.790251 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: Python main interpreter initialized at 0x562f3c16d9c0 Nov 08 16:10:23.790251 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: python threads support enabled Nov 08 16:10:23.790251 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: your server socket listen backlog is limited to 100 connections Nov 08 16:10:23.790251 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: your mercy for graceful operations on workers is 90 seconds Nov 08 16:10:23.790698 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: mapped 403077 bytes (393 KB) for 2 cores Nov 08 16:10:23.790782 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: *** Operational MODE: preforking *** Nov 08 16:10:23.791044 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: *** uWSGI is running in multiple interpreter mode *** Nov 08 16:10:23.791044 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: spawned uWSGI master process (pid: 115504) Nov 08 16:10:23.791232 dv-cinder-816187-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 08 16:10:23.791932 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: spawned uWSGI worker 1 (pid: 115523, cores: 1) Nov 08 16:10:23.794084 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: spawned uWSGI worker 2 (pid: 115524, cores: 1) Nov 08 16:10:23.794084 dv-cinder-816187-2-iscsi devstack@n-api.service[115504]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 08 16:10:25.615832 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 16:10:25.615832 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: from cryptography.utils import int_from_bytes Nov 08 16:10:25.616533 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 16:10:25.616533 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: from cryptography.utils import int_from_bytes Nov 08 16:10:25.621604 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 16:10:25.621604 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: from cryptography.utils import int_from_bytes Nov 08 16:10:25.624346 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 16:10:25.624346 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: from cryptography.utils import int_from_bytes Nov 08 16:10:28.155768 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 08 16:10:28.156282 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 08 16:10:28.156500 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 08 16:10:28.156793 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 08 16:10:28.157051 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 08 16:10:28.157444 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.157802 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.158131 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.158454 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.158788 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.159101 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.159426 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.159748 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.160084 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.160342 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.160663 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.160991 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816187-2-iscsi {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.161318 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.161631 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.161971 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.162289 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.162602 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.162929 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.163241 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.163740 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.165145 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.165145 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.165145 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.165145 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.166196 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.166393 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.166614 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.166929 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.167262 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.167583 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.167985 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816187-2-iscsi {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.168309 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.168644 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.168948 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.169377 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.169697 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.170031 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.170359 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.170689 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.171007 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.171340 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.171667 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.171995 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.172321 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.172630 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.172944 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.173258 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.173586 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.173920 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.174229 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.174483 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.174794 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.175121 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.175450 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.175778 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.176033 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.176286 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.176614 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.176939 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.177251 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.177566 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.177916 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.178218 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.178525 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.178839 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.179149 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.179461 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.179781 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.180095 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.180427 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.180736 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.181122 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.181530 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.181809 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.182122 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.182469 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.182793 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.183108 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.183434 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.183761 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.184068 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.184381 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.184694 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.185019 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.185366 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.185676 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.185899 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 08 16:10:28.186392 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.186549 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 08 16:10:28.186703 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.186703 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.186984 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 08 16:10:28.187125 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.187272 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 08 16:10:28.187425 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.187603 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 08 16:10:28.187768 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.187930 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.188082 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.188235 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.188387 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.188542 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.188842 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.188999 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.189170 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.189450 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.189630 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.189865 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.190025 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.190179 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.190321 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.190553 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.190716 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.190867 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.191019 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.191178 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.191392 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.191547 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.191696 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.191838 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816187-2-iscsi {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.191980 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.192140 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.192282 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.192438 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.192580 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.192727 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.192886 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.193040 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.193295 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.193457 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.193607 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.194015 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.194176 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.194325 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.194493 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.194493 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.194782 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.194955 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.195110 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.195253 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.195393 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.195533 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.195674 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.195828 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.195970 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.196129 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.196281 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.196429 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.197080 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.197259 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.197409 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.197556 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.197704 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.197881 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.198029 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.198260 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.198410 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.198552 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.198711 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816187-2-iscsi {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.199032 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.199194 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.199339 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.199641 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.199799 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.200038 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.200195 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.200195 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.200493 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.200735 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.200880 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.201031 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.201290 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.201532 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.201688 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.201872 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.202022 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.202182 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.202332 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.202475 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.202616 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.202764 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.202909 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.203060 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.203220 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.203472 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.203620 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.203769 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.203921 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.204186 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.204345 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.204489 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.204637 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.204778 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.204928 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.205070 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.205213 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.205368 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.205517 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.205667 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.205852 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.206009 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.206159 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.206306 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.206447 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.206588 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.206743 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.206895 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.207037 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.207037 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.207326 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.207480 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.207624 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.207771 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.207919 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.208069 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.208211 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.208366 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.208514 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.208670 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.208812 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.208979 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.209281 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.209431 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.209591 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.209950 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.210179 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.210333 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.210489 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.210631 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.210854 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.211002 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.211143 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.211327 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.211516 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.211730 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.211884 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.212034 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.212183 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.212412 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.212570 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.212719 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.212912 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.213066 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.213208 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.213357 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.213529 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.213784 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.213937 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.214086 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.214340 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.214498 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.214641 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.214790 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.214932 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.215082 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.215223 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.215373 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.215515 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.215666 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.215817 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.215967 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.215967 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.216249 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.216390 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.216531 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.216531 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.216819 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.216974 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.217117 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.217117 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.217383 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.217545 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.217687 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.217893 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.218036 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.218186 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.218368 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.218520 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.218668 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.218824 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.218966 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.219251 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.219409 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.219559 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.219711 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.220021 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.220196 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.220410 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.220564 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.220714 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.220958 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.221177 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.221323 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.221475 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.221617 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.221861 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.222024 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.222178 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.222332 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.222483 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.222631 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.222782 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.222933 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.223075 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.223223 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.223374 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.223522 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.223679 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.223934 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.224093 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.224246 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.224503 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.224660 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.224802 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.224951 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.225101 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.225251 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.225406 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.225550 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.225691 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.225865 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.226023 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.226175 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.226329 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.226471 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.226619 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.226761 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.226902 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.226902 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.227177 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.227177 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.227177 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.227593 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.227742 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.228392 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.228563 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.228714 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.228863 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.229011 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.229152 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.229444 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.229591 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.229797 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.230087 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.230087 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.230403 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.230630 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.230786 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.230947 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.231089 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.231313 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.231468 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.231620 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.231763 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.231998 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.232154 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.232296 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.232444 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.232600 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.232753 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.232912 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.233065 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.233216 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.233373 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.233534 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.233795 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.233976 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.234204 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.234357 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.234513 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.234663 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.234910 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:10:28.235066 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.235227 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.235378 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.235532 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.235683 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.235832 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.235976 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.236124 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.236273 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.236559 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.236730 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.236730 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.237003 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.237144 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.237304 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.237446 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.237594 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.237756 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.237905 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.238047 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.238204 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.238347 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.238494 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.238643 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.238785 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.238926 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.239091 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.239242 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.239533 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.239683 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.239832 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.239983 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.240277 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.240424 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.240573 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.240811 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.240965 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.241122 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.241265 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.241502 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.241655 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.241860 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.242033 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.242256 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.242405 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.242547 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.242695 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.242844 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.242993 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.243144 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.243295 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.243476 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.243660 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.243810 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.243952 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.244102 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.244339 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.244494 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.244637 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.244786 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.244959 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.245194 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.245348 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.245499 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.245641 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.245815 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.245974 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.246118 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.246118 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.246392 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.246535 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.246758 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.246910 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.247059 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.247209 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.247350 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.247493 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.247650 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.247800 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.247942 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.248090 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.248232 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.248382 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.248607 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.248757 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.249159 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.249302 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.249302 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.249768 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.249934 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.250088 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.250376 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.250525 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.250676 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.250834 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.251061 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.251208 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.251349 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.251509 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.251720 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.251874 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.252030 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.252179 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.252417 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.252572 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.252717 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.252867 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.253010 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.253160 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.253309 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.253467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.253611 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.253784 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.253932 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.254082 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.254224 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.254402 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.254635 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.254790 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.254934 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.255083 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.255244 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.255478 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.255641 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.255798 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.255949 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.256097 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.256252 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.256408 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.256579 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.257278 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.257440 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.257590 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.257771 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.257927 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.258095 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.258245 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.258392 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.258668 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.258836 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.258987 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.259823 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.259971 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.260228 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.260535 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.260685 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.260828 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.260984 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.261221 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.261369 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.261511 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.261652 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.261652 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.261652 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.262204 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.262354 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.262354 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.262713 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.262865 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.263007 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.263157 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.263307 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.263467 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.263708 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.263882 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.263882 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.264171 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.264332 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.264474 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.264615 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.264766 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.264915 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.265055 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.265204 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.265939 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.265939 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.266228 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.266372 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.266521 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.266673 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.266822 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.266976 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.267117 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.267265 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.267419 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.267561 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.267702 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.267852 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.268002 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.268150 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.268291 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.268433 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.268585 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.268735 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.268878 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.269025 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.269167 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.269307 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.269448 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.269598 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.269925 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.270089 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.270233 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.270375 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.270662 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.270823 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.270965 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.271105 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.271328 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.271328 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.271614 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.271756 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.271915 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.272128 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.272280 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.272442 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.272618 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.272845 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.273016 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.273183 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.273332 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.273479 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.273627 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.273797 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.273797 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.274108 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.274264 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.274413 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.274560 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.274762 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.274918 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.275090 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.275239 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.275386 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.275533 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.275687 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.276026 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.276192 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.276348 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.276497 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.276650 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.276800 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.277543 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.277722 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.277894 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.278053 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.278210 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.278367 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.278516 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.278908 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.279075 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.279238 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.279388 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.279543 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.279711 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.280017 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.280261 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.280421 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.280729 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.280904 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.281054 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.281054 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.281376 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.281614 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.281832 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.282035 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.282286 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.282453 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.282612 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.282769 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.283020 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.283183 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.283341 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.283505 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.283663 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.283818 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.283986 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.284213 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.284379 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.284542 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.284702 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.284858 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.285014 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.285162 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.285311 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.285466 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.285622 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.285790 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.285973 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.286324 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.286486 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.286648 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.286796 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.286954 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.287102 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.287250 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.287406 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.287567 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.287717 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.287864 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.287864 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.288152 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.288308 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.288457 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.288604 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.288767 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.288929 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.289086 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.289242 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.289399 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.289547 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.289694 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.290257 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.290257 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.291248 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.291406 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.291563 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.291965 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.292150 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.292318 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.292559 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.292661 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.292735 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.292804 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.292905 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.292994 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.293083 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.293175 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.293253 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.293337 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.293427 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.293519 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.293603 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.293684 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.293783 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.293917 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.294016 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.294117 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.294208 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.294308 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.294404 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.294488 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.294570 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.294660 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.294745 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.294827 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.294916 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.295005 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.295088 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.295180 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.295270 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.295360 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.295443 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.295532 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.295627 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.295717 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.295801 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.295883 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.295973 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.296057 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.296171 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.296415 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.296525 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.296611 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.296701 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.296791 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.296884 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.296968 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.297057 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.297147 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.297236 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.297318 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.297417 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.297508 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.297597 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.297680 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.297834 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.297929 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.298013 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.298094 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.298094 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.298252 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.298343 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.298434 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.298517 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.298599 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.298687 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.298687 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.298852 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.298943 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.299034 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.299123 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.299213 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.299296 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.299385 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.299479 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.299563 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.299651 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.299734 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.299823 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.299918 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.300002 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.300083 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.300165 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.300320 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.300421 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.300515 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.300599 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.300682 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.300763 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.300853 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.300944 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.301203 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.301305 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.301397 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.301488 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.301572 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.301654 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.301767 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.301912 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.302050 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.302139 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.302229 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.302326 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.302417 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.302500 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.302653 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.302754 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.302846 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.302928 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.303011 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.303099 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.303188 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.303351 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.303436 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.303518 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.303607 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.303690 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.303789 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.303879 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.303963 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.304095 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.304186 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.304278 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.304375 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.304460 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.304549 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.304672 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.304797 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.304917 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.305023 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.305110 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.305192 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.305280 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.305363 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.305452 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.305544 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.305628 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.305628 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.305848 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.305848 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.306092 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.306228 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.306328 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.306523 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.306628 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.306817 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.306923 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.307137 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.307229 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.307453 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.307554 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.307774 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.307873 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.308092 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.308182 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.308400 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.308497 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.308715 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.308822 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.309022 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.309119 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.309337 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.309427 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.309645 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.309761 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.309993 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.310093 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.310314 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.310431 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.310657 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.310766 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.311021 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.311126 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.311352 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.311505 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.311653 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.311782 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.311967 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.312086 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.312361 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.312692 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.313019 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.313107 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.313327 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.313416 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.313661 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.313814 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.314014 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.314104 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.314347 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.314426 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.314670 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.314759 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.314985 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.315071 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.315303 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.315382 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.315740 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.315960 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.316287 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.316663 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.316827 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.316917 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.317208 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.317324 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.317523 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.317614 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.317930 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.318076 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.318280 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.318375 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.318615 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.318712 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.318952 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.319056 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.319270 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.319384 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.319588 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.319822 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.319912 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.319995 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.320204 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.320305 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.320520 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.320625 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.320837 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.320938 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.321151 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.321243 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.321465 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.322143 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.322323 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.322457 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.322639 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.322753 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.322956 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.323059 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.323290 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.323392 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.323611 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.323701 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.323926 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.324016 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.324235 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.324337 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.324549 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.324637 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.324865 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.324961 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.325195 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.325295 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.325517 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.325614 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.325875 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.326043 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.326204 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.326354 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.326502 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.326640 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.326876 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.327017 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.327169 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.327321 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.327467 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.327604 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.327752 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.327896 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.328046 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.328186 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.328330 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.328475 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.328639 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.328781 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.328971 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.329119 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.329303 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.329451 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.329636 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.329864 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.330003 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.330150 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.330290 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.330433 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.330614 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.330760 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.330935 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.331074 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.331261 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.331402 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.331659 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.331804 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.331948 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.332037 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.332186 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.332285 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.332503 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.332681 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.332817 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.332930 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.333129 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.333231 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.333439 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.333548 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.333776 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.333878 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.334087 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.334187 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.334393 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.334492 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.334702 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.334799 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.335032 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.335134 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.335338 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.335437 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.335665 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.335763 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.335983 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.336146 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.336308 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.336459 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.336600 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.336746 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.336896 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.337051 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.337231 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.337399 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.337572 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.337730 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.337931 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.338072 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.338249 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.338390 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.338576 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.338717 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.338909 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.339046 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.339230 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.339372 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.339561 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.339714 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.339869 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.340009 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.340190 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.340330 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.340512 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.340666 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.340832 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.340980 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.341151 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.341293 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.341471 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.341643 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.341847 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.342014 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.342153 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.342293 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.342452 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.342602 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.342770 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.342936 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.343085 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.343227 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.343455 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.343643 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.343792 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.343981 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.344109 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.344304 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.344410 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.344627 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.344719 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.344949 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.345048 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.345269 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.345372 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.345586 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.345684 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.345934 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.346093 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.346254 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.346414 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.346575 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.346729 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.346890 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.347155 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.347257 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.347476 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.347573 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.347796 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.347887 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.348128 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.348232 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.348461 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.348552 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.348796 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.348893 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.349115 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.349248 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.349434 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.349536 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.349771 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.349872 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.350109 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.350203 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.350429 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.350525 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.350752 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.350903 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.351058 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.351205 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.351374 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.351520 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.351689 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.351791 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.352005 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.352163 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.352325 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.352457 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.352646 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.352799 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.353499 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.353619 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.353842 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.353969 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.354165 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.354291 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.354486 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.354620 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.354816 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.354958 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.355157 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.355309 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.355483 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.355574 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.355801 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.355899 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.356120 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.356233 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.356442 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.356534 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.356797 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.356963 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.357129 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.357290 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.357426 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.357626 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.357760 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.357984 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.358092 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.358314 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.358412 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.358639 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.358742 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.358958 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.359066 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.359289 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.359387 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.359607 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.359711 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.359916 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.360013 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.360239 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.360363 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.360539 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.360637 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.360851 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.361016 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.361179 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.361296 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.361493 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.361627 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.361831 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.361990 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.362181 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.362329 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.362477 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.362618 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.362925 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.363073 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.363227 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.363365 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.363583 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.363738 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.363879 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.364019 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.364206 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.364354 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.364528 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.364681 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.364873 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.365016 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.365212 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.365353 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.365525 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.365674 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.365862 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.365972 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.366186 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.366296 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.366503 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.366597 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.366812 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.366909 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.367121 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.367220 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.367433 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.367520 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.367747 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.367844 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.368061 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.368176 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.368376 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.368525 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.368739 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.368846 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.369054 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.369155 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.369368 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.369521 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.369661 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.369810 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.370003 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.370109 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.370321 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.370420 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.370632 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.370730 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.370952 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.371105 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.371254 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.371347 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.371562 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.371661 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.371881 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.372011 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.372195 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.372355 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.372510 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.372611 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.372820 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.372913 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.373136 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.373227 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.373444 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.373544 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.374029 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.374133 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.374349 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.374456 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.374680 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.374779 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.374992 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.375085 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.375302 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.375401 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.375625 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.375716 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.375942 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.376034 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.376263 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.376353 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.376579 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.376763 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.376893 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.376992 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.377214 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.377312 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.377538 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.377639 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.377901 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.378106 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.378449 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.378545 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.378789 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.378894 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.379111 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.379203 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.379434 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.379525 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.379755 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.379855 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.380064 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.380154 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.380373 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.380472 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.380700 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.380793 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.381016 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.381163 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.381333 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.381431 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.381648 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.381769 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.381993 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.382086 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.382377 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.382482 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.382628 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.382722 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.382942 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.383035 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.383258 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.383364 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.383574 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.383666 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.383915 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.384016 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.384791 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.384946 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.385091 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.385186 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.385413 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.385505 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.385754 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.385864 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.386074 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.386165 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.386389 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.386480 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.386705 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.386805 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.387018 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.387116 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.387338 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.387437 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.387672 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.387765 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.387991 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.388159 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.388305 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.388453 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.388622 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.388709 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.388933 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.389034 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.389258 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.389361 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.389593 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.389696 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.389972 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.390068 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.390301 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.390402 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.390630 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.390729 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.390943 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.391041 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.391267 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.391371 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.391582 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.391795 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.391920 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.392120 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.392264 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.392467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.392603 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.392801 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.392931 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.393139 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.393245 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.393467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.393638 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.393815 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.393947 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.394155 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.394266 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.394491 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.394588 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.394806 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.394898 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.395126 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.395227 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.395441 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.395540 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.395755 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.395853 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.396072 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.396165 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.396396 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.396487 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.396713 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.396827 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.397030 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.397122 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.397347 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.397441 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.397684 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.397931 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.398070 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.398278 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.398379 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.398609 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.398711 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.398928 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.399036 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.399244 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.399337 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.399558 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.399650 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.399948 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.400043 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.400281 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.400374 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.400594 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.400687 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.400911 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.401010 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.401229 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.401320 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.401549 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.401656 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.401890 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.401992 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.402210 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.402310 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.402663 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.402807 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.402908 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.403128 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.403237 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.403452 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.403551 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.403766 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.403857 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.404083 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.404177 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.404406 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.404505 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.404724 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.404818 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.405040 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.405139 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.405364 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.405455 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.405680 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.405861 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.406017 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.406117 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.406330 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.406435 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.406643 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.406751 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.406967 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.407085 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.407279 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.407384 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.407597 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.407689 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.407911 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.408004 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.408230 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.408334 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.408476 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 08 16:10:28.408576 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.408844 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.409157 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.409491 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.409839 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.410158 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.410491 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.410812 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.411207 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.411539 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.411865 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.412223 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.412554 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.413095 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.413494 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.413851 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.414210 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.414561 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.414882 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.415200 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.416041 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.416377 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.416699 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.417028 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.417349 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.417668 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.418010 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.418335 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.418653 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.418974 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.419293 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.419643 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.419972 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.420300 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.420626 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.420958 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.421280 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.421602 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.421943 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.422265 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.422737 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.422940 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.423263 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.423576 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.424009 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.424337 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.424662 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.424993 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.425312 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.425645 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.426004 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.426328 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.426766 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.427188 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.427411 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.427879 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.428102 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.428439 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.428755 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.429072 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.429387 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.429725 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.430078 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.430405 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.430738 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.431142 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.431480 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.431583 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_db.sqlalchemy.engines [None req-24ff3c24-47a3-4dd8-892d-e5aefa3fdbbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 16:10:28.431802 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.432139 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.432475 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.432808 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.433130 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.433491 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.433820 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.434145 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.434469 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.434788 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.435108 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.435429 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.435766 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.436103 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.436420 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.436757 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.437087 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.437417 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.437761 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.438083 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.438698 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.439030 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.439363 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.439689 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.440015 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.440342 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.440669 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.441015 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.441354 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.441692 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.442053 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.442412 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.442739 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.443094 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.443438 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.443763 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.444088 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.444406 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:10:28.444648 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 08 16:10:28.468099 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_db.sqlalchemy.engines [None req-f3689e1b-59b9-4571-be75-82e62ec5a824 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 16:10:28.498319 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.context [None req-24ff3c24-47a3-4dd8-892d-e5aefa3fdbbd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f1b83286-04a5-43a5-b4a1-4bd0edc3473b(cell1) {{(pid=115523) load_cells /opt/stack/nova/nova/context.py:464}} Nov 08 16:10:28.503041 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-24ff3c24-47a3-4dd8-892d-e5aefa3fdbbd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:10:28.504756 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-24ff3c24-47a3-4dd8-892d-e5aefa3fdbbd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:10:28.505574 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-24ff3c24-47a3-4dd8-892d-e5aefa3fdbbd None None] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:10:28.507509 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-24ff3c24-47a3-4dd8-892d-e5aefa3fdbbd None None] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:10:28.518792 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_db.sqlalchemy.engines [None req-24ff3c24-47a3-4dd8-892d-e5aefa3fdbbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 16:10:28.519631 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_db.sqlalchemy.engines [None req-24ff3c24-47a3-4dd8-892d-e5aefa3fdbbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 16:10:28.535461 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.context [None req-f3689e1b-59b9-4571-be75-82e62ec5a824 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f1b83286-04a5-43a5-b4a1-4bd0edc3473b(cell1) {{(pid=115524) load_cells /opt/stack/nova/nova/context.py:464}} Nov 08 16:10:28.539723 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f3689e1b-59b9-4571-be75-82e62ec5a824 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:10:28.541357 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f3689e1b-59b9-4571-be75-82e62ec5a824 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:10:28.542204 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f3689e1b-59b9-4571-be75-82e62ec5a824 None None] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:10:28.544152 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f3689e1b-59b9-4571-be75-82e62ec5a824 None None] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:10:28.554538 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_db.sqlalchemy.engines [None req-f3689e1b-59b9-4571-be75-82e62ec5a824 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 16:10:28.555376 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_db.sqlalchemy.engines [None req-f3689e1b-59b9-4571-be75-82e62ec5a824 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 16:10:28.774552 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_db.sqlalchemy.engines [None req-24ff3c24-47a3-4dd8-892d-e5aefa3fdbbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 16:10:28.820747 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_db.sqlalchemy.engines [None req-f3689e1b-59b9-4571-be75-82e62ec5a824 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 16:10:29.105413 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: WARNING keystonemiddleware.auth_token [None req-24ff3c24-47a3-4dd8-892d-e5aefa3fdbbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 08 16:10:29.112146 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: WARNING keystonemiddleware.auth_token [None req-24ff3c24-47a3-4dd8-892d-e5aefa3fdbbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 08 16:10:29.146442 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: WARNING keystonemiddleware.auth_token [None req-f3689e1b-59b9-4571-be75-82e62ec5a824 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 08 16:10:29.154690 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: WARNING keystonemiddleware.auth_token [None req-f3689e1b-59b9-4571-be75-82e62ec5a824 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 08 16:10:29.462744 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: WARNING keystonemiddleware.auth_token [None req-24ff3c24-47a3-4dd8-892d-e5aefa3fdbbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 08 16:10:29.467848 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: WARNING keystonemiddleware.auth_token [None req-24ff3c24-47a3-4dd8-892d-e5aefa3fdbbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 08 16:10:29.474034 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562f3c16d9c0 pid: 115523 (default app) Nov 08 16:10:29.501080 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: WARNING keystonemiddleware.auth_token [None req-f3689e1b-59b9-4571-be75-82e62ec5a824 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 08 16:10:29.507418 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: WARNING keystonemiddleware.auth_token [None req-f3689e1b-59b9-4571-be75-82e62ec5a824 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 08 16:10:29.513090 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562f3c16d9c0 pid: 115524 (default app) Nov 08 16:11:03.148108 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c7563068-0de2-4d74-8a41-7fe750083a07 tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] Action: 'create', calling method: .version_select at 0x7f8c0d3d1280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1972469272", "metadata": {"Type": "work"}}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:11:03.155319 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c7563068-0de2-4d74-8a41-7fe750083a07 tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:11:03.156633 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c7563068-0de2-4d74-8a41-7fe750083a07 tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.333018 Nov 08 16:11:03.157543 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 1/1] 10.222.0.37 () {60 vars in 1155 bytes} [Mon Nov 8 16:11:01 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1335 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 08 16:11:03.553121 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-64fa8786-3f2f-4a47-9cdd-688b2689096b tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] Action: 'create', calling method: .version_select at 0x7f8c0d3fbee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1272186845", "metadata": {"Type": "work"}}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:11:03.555942 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-64fa8786-3f2f-4a47-9cdd-688b2689096b tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:11:03.558628 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-64fa8786-3f2f-4a47-9cdd-688b2689096b tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.390083 Nov 08 16:11:03.560177 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 1/2] 10.222.0.37 () {60 vars in 1155 bytes} [Mon Nov 8 16:11:03 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 396 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 08 16:11:03.569253 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d8362829-475c-462d-b49d-320bbb7a2786 tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] Action: 'create', calling method: .version_select at 0x7f8c0d3d1e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-549830496", "metadata": {"Type": "work"}}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:11:03.571108 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d8362829-475c-462d-b49d-320bbb7a2786 tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:11:03.572215 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d8362829-475c-462d-b49d-320bbb7a2786 tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006851 Nov 08 16:11:03.572961 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 2/3] 10.222.0.37 () {60 vars in 1155 bytes} [Mon Nov 8 16:11:03 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 08 16:11:03.590260 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-44f42c1c-e9a0-49d6-a786-a7c3fdc248ea tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] Calling method '.version_select at 0x7f8c0d2faaf0>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:04.219867 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-44f42c1c-e9a0-49d6-a786-a7c3fdc248ea tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] HTTP exception thrown: Volume tempest-invalid-1126566520 could not be found. Nov 08 16:11:04.220621 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-44f42c1c-e9a0-49d6-a786-a7c3fdc248ea tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] Returning 404 to user: Volume tempest-invalid-1126566520 could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:11:04.221572 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-44f42c1c-e9a0-49d6-a786-a7c3fdc248ea tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1126566520" status: 404 len: 99 microversion: 2.1 time: 0.640104 Nov 08 16:11:04.222431 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 2/4] 10.222.0.37 () {58 vars in 1217 bytes} [Mon Nov 8 16:11:03 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1126566520 => generated 99 bytes in 641 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 08 16:11:04.233616 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-dc7f7a7a-ae0e-4d0c-bd8f-49c65ae85b53 tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003909 Nov 08 16:11:04.235600 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 3/5] 10.222.0.37 () {58 vars in 1139 bytes} [Mon Nov 8 16:11:04 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 08 16:11:04.243960 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3cd843d6-2d00-421f-8518-9576f84a94f2 tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004138 Nov 08 16:11:04.244988 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 3/6] 10.222.0.37 () {58 vars in 1136 bytes} [Mon Nov 8 16:11:04 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 08 16:11:04.254081 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-88272506-971d-4008-91e1-c984f9e30428 tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] Calling method '.version_select at 0x7f8c0d3d1940>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:04.781831 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-88272506-971d-4008-91e1-c984f9e30428 tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] HTTP exception thrown: Volume 98792e8e-3242-4a5d-86b6-f2e1943b8cb0 could not be found. Nov 08 16:11:04.782881 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-88272506-971d-4008-91e1-c984f9e30428 tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] Returning 404 to user: Volume 98792e8e-3242-4a5d-86b6-f2e1943b8cb0 could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:11:04.784040 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-88272506-971d-4008-91e1-c984f9e30428 tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/98792e8e-3242-4a5d-86b6-f2e1943b8cb0" status: 404 len: 109 microversion: 2.1 time: 0.533872 Nov 08 16:11:04.784781 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 4/7] 10.222.0.37 () {58 vars in 1247 bytes} [Mon Nov 8 16:11:04 2021] DELETE /compute/v2.1/os-volumes/98792e8e-3242-4a5d-86b6-f2e1943b8cb0 => generated 109 bytes in 535 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 08 16:11:04.794947 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c45157df-30ba-48e7-9bec-ef72c1d8213c tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] Calling method '.version_select at 0x7f8c0d29a3a0>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:05.040190 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-c45157df-30ba-48e7-9bec-ef72c1d8213c tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] HTTP exception thrown: Volume 0be56d8b-e091-4b88-97cb-56d7e99cd603 could not be found. Nov 08 16:11:05.040794 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c45157df-30ba-48e7-9bec-ef72c1d8213c tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] Returning 404 to user: Volume 0be56d8b-e091-4b88-97cb-56d7e99cd603 could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:11:05.041633 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c45157df-30ba-48e7-9bec-ef72c1d8213c tempest-VolumesNegativeTest-1770777002 tempest-VolumesNegativeTest-1770777002-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/0be56d8b-e091-4b88-97cb-56d7e99cd603" status: 404 len: 109 microversion: 2.1 time: 0.250998 Nov 08 16:11:05.052448 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 4/8] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Nov 8 16:11:04 2021] GET /compute/v2.1/os-volumes/0be56d8b-e091-4b88-97cb-56d7e99cd603 => generated 109 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:11:05.240106 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-978226708", "imageRef": "9abeafba-e602-4e0a-aab2-62160562de06", "flavorRef": "452", "networks": [{"uuid": "8d351af8-ed05-48f5-939b-8cf227b5c91c"}]}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:11:05.446654 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.network.neutron [None req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] validate_networks() for [('8d351af8-ed05-48f5-939b-8cf227b5c91c', None, None, None, None, None)] {{(pid=115523) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:11:07.276619 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1990351391", "imageRef": "9abeafba-e602-4e0a-aab2-62160562de06", "flavorRef": "452", "networks": [{"uuid": "f70ee550-62a6-48db-bca5-a0b964bbcce9"}]}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:11:07.398543 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Flavor limits 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:11:07.400061 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Image limits 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:11:07.402543 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Flavor pref 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:11:07.403158 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Image pref 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:11:07.403790 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:11:07.414444 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.network.neutron [None req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] validate_networks() for [('f70ee550-62a6-48db-bca5-a0b964bbcce9', None, None, None, None, None)] {{(pid=115524) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:11:07.447890 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:07.448613 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:07.449696 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:07.451947 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:07.567500 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Getting quotas for project 170b9e4079834c589534d39e70e1dba3. Resources: {'instances', 'ram', 'cores'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:11:07.581573 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Getting quotas for user 718d3c695a2f45aa8ac4c6c01d28265b and project 170b9e4079834c589534d39e70e1dba3. Resources: {'instances', 'ram', 'cores'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:11:07.599366 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Going to run 1 instances... {{(pid=115523) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:11:07.603265 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9abeafba-e602-4e0a-aab2-62160562de06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:11:07.754549 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.718131 Nov 08 16:11:07.760461 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 5/9] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Nov 8 16:11:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 2720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 16:11:07.769735 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4a03c93c-931c-4ca0-ab2f-af588cbd78c7 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:07.772238 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4a03c93c-931c-4ca0-ab2f-af588cbd78c7 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:08.066923 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4a03c93c-931c-4ca0-ab2f-af588cbd78c7 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:08.115164 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4a03c93c-931c-4ca0-ab2f-af588cbd78c7 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1214 microversion: 2.1 time: 0.353283 Nov 08 16:11:08.117602 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 6/10] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:07 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1214 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:09.134520 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-31eab3a8-4404-4e49-b08a-b8e3e4b2b206 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:09.135204 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-31eab3a8-4404-4e49-b08a-b8e3e4b2b206 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:09.264272 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-31eab3a8-4404-4e49-b08a-b8e3e4b2b206 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:09.275612 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-31eab3a8-4404-4e49-b08a-b8e3e4b2b206 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1214 microversion: 2.1 time: 0.145350 Nov 08 16:11:09.295470 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 7/11] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:09 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:09.779343 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Flavor limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:11:09.779896 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Image limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:11:09.780232 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Flavor pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:11:09.780636 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Image pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:11:09.781039 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:11:09.829091 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:09.829543 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:09.834573 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:09.835060 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:09.928138 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Getting quotas for project 549e9715f7424ff5b3b252f354adafe9. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:11:09.947766 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Getting quotas for user fc7bdbcc6f4845d590103ec01173c2cb and project 549e9715f7424ff5b3b252f354adafe9. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:11:09.977562 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Going to run 1 instances... {{(pid=115524) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:11:09.987459 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9abeafba-e602-4e0a-aab2-62160562de06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:11:10.232472 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.392596 Nov 08 16:11:10.233119 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 5/12] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Nov 8 16:11:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 3394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 16:11:10.246720 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1d256108-fc1e-4fe5-bbe2-5e1d92d099a9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:10.248120 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1d256108-fc1e-4fe5-bbe2-5e1d92d099a9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:10.298953 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9ee9b6d3-ad86-49d2-82d8-3eb257d87281 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:10.300117 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9ee9b6d3-ad86-49d2-82d8-3eb257d87281 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:10.339078 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ee9b6d3-ad86-49d2-82d8-3eb257d87281 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:10.341021 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ee9b6d3-ad86-49d2-82d8-3eb257d87281 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:10.354850 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ee9b6d3-ad86-49d2-82d8-3eb257d87281 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:10.356073 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ee9b6d3-ad86-49d2-82d8-3eb257d87281 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:10.466070 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1d256108-fc1e-4fe5-bbe2-5e1d92d099a9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:10.476551 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1d256108-fc1e-4fe5-bbe2-5e1d92d099a9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1218 microversion: 2.1 time: 0.235837 Nov 08 16:11:10.481431 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 8/13] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:10 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1218 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:10.723662 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-9ee9b6d3-ad86-49d2-82d8-3eb257d87281 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:10.770588 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9ee9b6d3-ad86-49d2-82d8-3eb257d87281 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1210 microversion: 2.1 time: 0.473932 Nov 08 16:11:10.774557 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 6/14] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:10 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1210 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:11.497944 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c3417b46-e0f5-4700-9b66-9a298a475e06 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:11.500218 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c3417b46-e0f5-4700-9b66-9a298a475e06 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:11.787966 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c3417b46-e0f5-4700-9b66-9a298a475e06 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:11.795100 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-029faaba-8bcb-47f0-bf07-8b5fd9e4f7d8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:11.798095 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-029faaba-8bcb-47f0-bf07-8b5fd9e4f7d8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:11.808692 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c3417b46-e0f5-4700-9b66-9a298a475e06 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1218 microversion: 2.1 time: 0.314905 Nov 08 16:11:11.824791 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 9/15] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:11 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1218 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:11.827308 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-029faaba-8bcb-47f0-bf07-8b5fd9e4f7d8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:11.916215 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-029faaba-8bcb-47f0-bf07-8b5fd9e4f7d8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:11.925887 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-029faaba-8bcb-47f0-bf07-8b5fd9e4f7d8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:11.928389 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-029faaba-8bcb-47f0-bf07-8b5fd9e4f7d8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:12.130286 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-029faaba-8bcb-47f0-bf07-8b5fd9e4f7d8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:12.153360 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-029faaba-8bcb-47f0-bf07-8b5fd9e4f7d8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1272 microversion: 2.1 time: 0.362511 Nov 08 16:11:12.154175 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 7/16] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:11 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1272 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:12.842123 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1095210c-ca27-4de3-aaa4-3f23fd30f357 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:12.844704 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1095210c-ca27-4de3-aaa4-3f23fd30f357 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:12.870169 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1095210c-ca27-4de3-aaa4-3f23fd30f357 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:12.871046 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1095210c-ca27-4de3-aaa4-3f23fd30f357 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:12.871889 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1095210c-ca27-4de3-aaa4-3f23fd30f357 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:12.872331 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1095210c-ca27-4de3-aaa4-3f23fd30f357 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:13.171625 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-775de92a-d3d8-42e3-adfe-ee4662f671bf tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:13.172914 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-775de92a-d3d8-42e3-adfe-ee4662f671bf tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:13.187768 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-775de92a-d3d8-42e3-adfe-ee4662f671bf tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:13.190627 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-775de92a-d3d8-42e3-adfe-ee4662f671bf tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:13.193543 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-775de92a-d3d8-42e3-adfe-ee4662f671bf tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:13.197784 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-775de92a-d3d8-42e3-adfe-ee4662f671bf tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:13.567162 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-775de92a-d3d8-42e3-adfe-ee4662f671bf tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:13.567914 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1095210c-ca27-4de3-aaa4-3f23fd30f357 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:13.602591 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-775de92a-d3d8-42e3-adfe-ee4662f671bf tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1272 microversion: 2.1 time: 0.435487 Nov 08 16:11:13.603235 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 8/17] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:13 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1272 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:13.645165 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1095210c-ca27-4de3-aaa4-3f23fd30f357 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1278 microversion: 2.1 time: 0.815347 Nov 08 16:11:13.677176 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 10/18] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:12 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1278 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:14.620580 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e62765d8-f342-4cb7-afb9-5ad472b2cdc6 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:14.622721 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e62765d8-f342-4cb7-afb9-5ad472b2cdc6 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:14.652806 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e62765d8-f342-4cb7-afb9-5ad472b2cdc6 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:14.657370 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e62765d8-f342-4cb7-afb9-5ad472b2cdc6 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:14.660448 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e62765d8-f342-4cb7-afb9-5ad472b2cdc6 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:14.662526 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e62765d8-f342-4cb7-afb9-5ad472b2cdc6 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:14.787780 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-e62765d8-f342-4cb7-afb9-5ad472b2cdc6 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:14.800366 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e62765d8-f342-4cb7-afb9-5ad472b2cdc6 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1272 microversion: 2.1 time: 0.181933 Nov 08 16:11:14.803810 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 11/19] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:14 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:14.811897 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1b04a20a-2d83-477c-9547-8ce246ad57dd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:14.823365 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1b04a20a-2d83-477c-9547-8ce246ad57dd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:14.831613 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1b04a20a-2d83-477c-9547-8ce246ad57dd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:14.832465 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1b04a20a-2d83-477c-9547-8ce246ad57dd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:14.834150 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1b04a20a-2d83-477c-9547-8ce246ad57dd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:14.834746 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1b04a20a-2d83-477c-9547-8ce246ad57dd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:14.948428 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-de28967e-da34-4a44-9b0e-dd7104343b6c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'create', calling method: .version_select at 0x7f8c0c097f70>, body: {"keypair": {"name": "tempest-keypair-1427302328"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:11:14.975894 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1b04a20a-2d83-477c-9547-8ce246ad57dd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:14.985053 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1b04a20a-2d83-477c-9547-8ce246ad57dd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1276 microversion: 2.1 time: 0.179827 Nov 08 16:11:15.002357 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 12/20] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:14 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1276 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:15.035361 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-de28967e-da34-4a44-9b0e-dd7104343b6c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Getting quotas for project 10a4252a63bf480d93d2e9da15bb8efd. Resources: {'key_pairs'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:11:15.046106 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-de28967e-da34-4a44-9b0e-dd7104343b6c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Getting quotas for user 5f2f258a03f24a94a7da462be24b1d3b and project 10a4252a63bf480d93d2e9da15bb8efd. Resources: {'key_pairs'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:11:15.437098 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-de28967e-da34-4a44-9b0e-dd7104343b6c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Getting quotas for project 10a4252a63bf480d93d2e9da15bb8efd. Resources: {'key_pairs'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:11:15.444032 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-de28967e-da34-4a44-9b0e-dd7104343b6c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Getting quotas for user 5f2f258a03f24a94a7da462be24b1d3b and project 10a4252a63bf480d93d2e9da15bb8efd. Resources: {'key_pairs'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:11:15.480075 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-de28967e-da34-4a44-9b0e-dd7104343b6c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.079669 Nov 08 16:11:15.481378 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 9/21] 10.222.0.37 () {62 vars in 1198 bytes} [Mon Nov 8 16:11:14 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1082 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 08 16:11:15.820580 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-fc225157-3a87-4f3c-b245-8918184c8d9e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:15.821447 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fc225157-3a87-4f3c-b245-8918184c8d9e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:15.843896 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fc225157-3a87-4f3c-b245-8918184c8d9e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:15.844196 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fc225157-3a87-4f3c-b245-8918184c8d9e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:15.844980 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fc225157-3a87-4f3c-b245-8918184c8d9e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:15.852873 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fc225157-3a87-4f3c-b245-8918184c8d9e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:16.013037 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-67123b31-1ada-4a22-813e-379ba7f6878b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:16.015800 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-67123b31-1ada-4a22-813e-379ba7f6878b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:16.044019 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-67123b31-1ada-4a22-813e-379ba7f6878b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:16.044533 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-67123b31-1ada-4a22-813e-379ba7f6878b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:16.045335 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-67123b31-1ada-4a22-813e-379ba7f6878b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:16.063157 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-67123b31-1ada-4a22-813e-379ba7f6878b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:16.071256 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fc225157-3a87-4f3c-b245-8918184c8d9e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:16.079308 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-fc225157-3a87-4f3c-b245-8918184c8d9e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1272 microversion: 2.1 time: 0.263666 Nov 08 16:11:16.084040 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 13/22] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:15 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1272 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:16.312914 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-67123b31-1ada-4a22-813e-379ba7f6878b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:16.321159 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-67123b31-1ada-4a22-813e-379ba7f6878b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1276 microversion: 2.1 time: 0.318624 Nov 08 16:11:16.321738 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 10/23] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:16 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1276 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:17.105644 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b0b8e072-694f-4a78-bd4c-f7f1c91e4017 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:17.107316 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b0b8e072-694f-4a78-bd4c-f7f1c91e4017 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:17.129288 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b0b8e072-694f-4a78-bd4c-f7f1c91e4017 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:17.130837 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b0b8e072-694f-4a78-bd4c-f7f1c91e4017 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:17.133823 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b0b8e072-694f-4a78-bd4c-f7f1c91e4017 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:17.134272 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b0b8e072-694f-4a78-bd4c-f7f1c91e4017 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:17.340920 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1e9178c9-0f2e-4ef0-920a-15217f1a72fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:17.341542 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1e9178c9-0f2e-4ef0-920a-15217f1a72fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:17.361517 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1e9178c9-0f2e-4ef0-920a-15217f1a72fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:17.367208 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1e9178c9-0f2e-4ef0-920a-15217f1a72fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:17.370108 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1e9178c9-0f2e-4ef0-920a-15217f1a72fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:17.370431 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1e9178c9-0f2e-4ef0-920a-15217f1a72fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:17.828966 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b0b8e072-694f-4a78-bd4c-f7f1c91e4017 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:17.838175 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b0b8e072-694f-4a78-bd4c-f7f1c91e4017 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1272 microversion: 2.1 time: 0.737392 Nov 08 16:11:17.847264 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 14/24] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:17 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1272 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:17.917662 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1e9178c9-0f2e-4ef0-920a-15217f1a72fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:17.928544 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1e9178c9-0f2e-4ef0-920a-15217f1a72fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1276 microversion: 2.1 time: 0.590527 Nov 08 16:11:17.929244 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 11/25] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:17 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1276 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:18.857053 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-2b5f4c10-c894-433a-944d-5832cd2c5c8a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:18.858256 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-2b5f4c10-c894-433a-944d-5832cd2c5c8a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:18.870021 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2b5f4c10-c894-433a-944d-5832cd2c5c8a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:18.870469 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2b5f4c10-c894-433a-944d-5832cd2c5c8a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:18.887062 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2b5f4c10-c894-433a-944d-5832cd2c5c8a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:18.887507 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2b5f4c10-c894-433a-944d-5832cd2c5c8a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:18.947315 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-456514b1-7e63-4805-9ed1-b3272e4ed409 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:18.947935 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-456514b1-7e63-4805-9ed1-b3272e4ed409 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:18.965746 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-456514b1-7e63-4805-9ed1-b3272e4ed409 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:18.974483 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-456514b1-7e63-4805-9ed1-b3272e4ed409 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:18.975501 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-456514b1-7e63-4805-9ed1-b3272e4ed409 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:18.978180 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-456514b1-7e63-4805-9ed1-b3272e4ed409 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:19.848941 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-2b5f4c10-c894-433a-944d-5832cd2c5c8a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:19.861986 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-2b5f4c10-c894-433a-944d-5832cd2c5c8a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 1.009076 Nov 08 16:11:19.862618 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-456514b1-7e63-4805-9ed1-b3272e4ed409 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:19.866082 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 15/26] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:18 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:19.875430 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-456514b1-7e63-4805-9ed1-b3272e4ed409 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.932029 Nov 08 16:11:19.878206 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 12/27] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:18 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:20.886617 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-7d6629a4-0be0-43ad-a785-20be29e4eecc tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:20.887240 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-7d6629a4-0be0-43ad-a785-20be29e4eecc tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:20.897527 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c5a689b9-ab38-4d0b-8c77-ab98e67030c5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:20.899550 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c5a689b9-ab38-4d0b-8c77-ab98e67030c5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:20.922039 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c5a689b9-ab38-4d0b-8c77-ab98e67030c5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:20.922604 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c5a689b9-ab38-4d0b-8c77-ab98e67030c5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:20.924405 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c5a689b9-ab38-4d0b-8c77-ab98e67030c5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:20.930057 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7d6629a4-0be0-43ad-a785-20be29e4eecc tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:20.930671 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7d6629a4-0be0-43ad-a785-20be29e4eecc tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:20.931517 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7d6629a4-0be0-43ad-a785-20be29e4eecc tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:20.931952 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7d6629a4-0be0-43ad-a785-20be29e4eecc tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:20.932939 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c5a689b9-ab38-4d0b-8c77-ab98e67030c5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:22.136435 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c5a689b9-ab38-4d0b-8c77-ab98e67030c5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:22.147809 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c5a689b9-ab38-4d0b-8c77-ab98e67030c5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 1.251664 Nov 08 16:11:22.149631 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 13/28] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:20 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:22.162849 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7d6629a4-0be0-43ad-a785-20be29e4eecc tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:22.171714 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-7d6629a4-0be0-43ad-a785-20be29e4eecc tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 1.290991 Nov 08 16:11:22.177821 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 16/29] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:20 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:22.346200 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2c11596b-e0dc-408c-b49c-979c4e50cd84 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1756867536", "imageRef": "9abeafba-e602-4e0a-aab2-62160562de06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0e08679-82fe-47eb-90b6-49a1713fdaca"}], "security_groups": [{"name": "tempest-securitygroup--1194879682"}], "key_name": "tempest-keypair-1427302328", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:11:22.644304 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.network.neutron [None req-2c11596b-e0dc-408c-b49c-979c4e50cd84 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] validate_networks() for [('e0e08679-82fe-47eb-90b6-49a1713fdaca', None, None, None, None, None)] {{(pid=115524) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:11:23.167703 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-11289e79-0006-4048-9faa-20e5432f21d7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:23.168313 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-11289e79-0006-4048-9faa-20e5432f21d7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:23.181009 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-11289e79-0006-4048-9faa-20e5432f21d7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:23.181459 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-11289e79-0006-4048-9faa-20e5432f21d7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:23.182279 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-11289e79-0006-4048-9faa-20e5432f21d7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:23.182708 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-11289e79-0006-4048-9faa-20e5432f21d7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:23.960552 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-11289e79-0006-4048-9faa-20e5432f21d7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:23.971221 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-11289e79-0006-4048-9faa-20e5432f21d7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.807063 Nov 08 16:11:23.987744 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 17/30] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:23 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:23.993283 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d3e624a9-a208-44c8-8633-bbf09e4cec45 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:24.011531 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d3e624a9-a208-44c8-8633-bbf09e4cec45 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:24.035450 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d3e624a9-a208-44c8-8633-bbf09e4cec45 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:24.037261 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d3e624a9-a208-44c8-8633-bbf09e4cec45 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:24.038378 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d3e624a9-a208-44c8-8633-bbf09e4cec45 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:24.048696 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d3e624a9-a208-44c8-8633-bbf09e4cec45 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:24.166525 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-2c11596b-e0dc-408c-b49c-979c4e50cd84 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Flavor limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:11:24.167172 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-2c11596b-e0dc-408c-b49c-979c4e50cd84 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Image limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:11:24.167551 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-2c11596b-e0dc-408c-b49c-979c4e50cd84 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Flavor pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:11:24.168256 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-2c11596b-e0dc-408c-b49c-979c4e50cd84 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Image pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:11:24.168834 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-2c11596b-e0dc-408c-b49c-979c4e50cd84 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:11:24.190356 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2c11596b-e0dc-408c-b49c-979c4e50cd84 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:24.191392 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2c11596b-e0dc-408c-b49c-979c4e50cd84 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:24.199764 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2c11596b-e0dc-408c-b49c-979c4e50cd84 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:24.200641 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2c11596b-e0dc-408c-b49c-979c4e50cd84 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:24.258374 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-2c11596b-e0dc-408c-b49c-979c4e50cd84 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Getting quotas for project 10a4252a63bf480d93d2e9da15bb8efd. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:11:24.271846 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-2c11596b-e0dc-408c-b49c-979c4e50cd84 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Getting quotas for user 5f2f258a03f24a94a7da462be24b1d3b and project 10a4252a63bf480d93d2e9da15bb8efd. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:11:24.305337 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2c11596b-e0dc-408c-b49c-979c4e50cd84 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Going to run 1 instances... {{(pid=115524) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:11:24.313001 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2c11596b-e0dc-408c-b49c-979c4e50cd84 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9abeafba-e602-4e0a-aab2-62160562de06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:11:24.488551 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2c11596b-e0dc-408c-b49c-979c4e50cd84 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.140455 Nov 08 16:11:24.493519 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 14/31] 10.222.0.37 () {62 vars in 1187 bytes} [Mon Nov 8 16:11:22 2021] POST /compute/v2.1/servers => generated 402 bytes in 2155 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 08 16:11:24.504100 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4da67140-d7aa-4f9f-8d3c-b8e5a661f3b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:24.505609 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4da67140-d7aa-4f9f-8d3c-b8e5a661f3b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:24.552390 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d3e624a9-a208-44c8-8633-bbf09e4cec45 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:24.562201 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d3e624a9-a208-44c8-8633-bbf09e4cec45 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.572718 Nov 08 16:11:24.562780 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 18/32] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:23 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:24.668064 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4da67140-d7aa-4f9f-8d3c-b8e5a661f3b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:24.697973 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4da67140-d7aa-4f9f-8d3c-b8e5a661f3b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:24.699840 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4da67140-d7aa-4f9f-8d3c-b8e5a661f3b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:24.703015 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4da67140-d7aa-4f9f-8d3c-b8e5a661f3b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1282 microversion: 2.20 time: 0.203018 Nov 08 16:11:24.710772 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 15/33] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:24 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1282 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:11:24.999987 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a5995145-a46d-44d3-ae43-68f6debc5943 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:24.999987 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a5995145-a46d-44d3-ae43-68f6debc5943 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:25.018971 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a5995145-a46d-44d3-ae43-68f6debc5943 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:25.024262 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a5995145-a46d-44d3-ae43-68f6debc5943 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:25.025301 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a5995145-a46d-44d3-ae43-68f6debc5943 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:25.025981 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a5995145-a46d-44d3-ae43-68f6debc5943 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:25.358867 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a5995145-a46d-44d3-ae43-68f6debc5943 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:25.366864 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a5995145-a46d-44d3-ae43-68f6debc5943 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.374570 Nov 08 16:11:25.379046 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 19/34] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:24 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:25.580035 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-fb2f526e-8f51-4d7a-b0bd-41444e9037dc tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:25.581530 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-fb2f526e-8f51-4d7a-b0bd-41444e9037dc tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:25.598600 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fb2f526e-8f51-4d7a-b0bd-41444e9037dc tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:25.600892 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fb2f526e-8f51-4d7a-b0bd-41444e9037dc tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:25.606393 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fb2f526e-8f51-4d7a-b0bd-41444e9037dc tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:25.609064 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fb2f526e-8f51-4d7a-b0bd-41444e9037dc tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:26.080357 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-fb2f526e-8f51-4d7a-b0bd-41444e9037dc tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:26.096557 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-fb2f526e-8f51-4d7a-b0bd-41444e9037dc tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.518127 Nov 08 16:11:26.098471 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 16/35] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:25 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:26.126247 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-8dfc4853-26d9-4689-bc72-74fe3e3e5f45 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:26.127492 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-8dfc4853-26d9-4689-bc72-74fe3e3e5f45 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:26.151311 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8dfc4853-26d9-4689-bc72-74fe3e3e5f45 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:26.151894 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8dfc4853-26d9-4689-bc72-74fe3e3e5f45 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:26.152941 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8dfc4853-26d9-4689-bc72-74fe3e3e5f45 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:26.157686 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8dfc4853-26d9-4689-bc72-74fe3e3e5f45 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:26.257958 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-cae5de2e-f902-466c-bfc7-a3aee30e299d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'create', calling method: .version_select at 0x7f8c0c0331f0>, body: {"keypair": {"name": "tempest-keypair-1447147253"}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:11:26.319831 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-cae5de2e-f902-466c-bfc7-a3aee30e299d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Getting quotas for project f6e779f0506643d08d984c2971d5a71c. Resources: {'key_pairs'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:11:26.331193 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-cae5de2e-f902-466c-bfc7-a3aee30e299d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Getting quotas for user 3924bafb69cd45709eb3878837741eef and project f6e779f0506643d08d984c2971d5a71c. Resources: {'key_pairs'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:11:26.422656 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-8dfc4853-26d9-4689-bc72-74fe3e3e5f45 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:26.430756 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-8dfc4853-26d9-4689-bc72-74fe3e3e5f45 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:26.432282 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-8dfc4853-26d9-4689-bc72-74fe3e3e5f45 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:26.433389 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-8dfc4853-26d9-4689-bc72-74fe3e3e5f45 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1334 microversion: 2.20 time: 0.330278 Nov 08 16:11:26.435783 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 17/36] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:26 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1334 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:11:26.440546 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7e83102d-ebd7-4913-b0d9-5f173dfad58d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:26.441843 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7e83102d-ebd7-4913-b0d9-5f173dfad58d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:26.469229 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7e83102d-ebd7-4913-b0d9-5f173dfad58d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:26.470024 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7e83102d-ebd7-4913-b0d9-5f173dfad58d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:26.471097 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7e83102d-ebd7-4913-b0d9-5f173dfad58d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:26.471683 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7e83102d-ebd7-4913-b0d9-5f173dfad58d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:26.745800 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7e83102d-ebd7-4913-b0d9-5f173dfad58d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:26.757356 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7e83102d-ebd7-4913-b0d9-5f173dfad58d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.318221 Nov 08 16:11:26.768003 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 18/37] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:26 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:26.817009 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-cae5de2e-f902-466c-bfc7-a3aee30e299d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Getting quotas for project f6e779f0506643d08d984c2971d5a71c. Resources: {'key_pairs'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:11:26.825990 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-cae5de2e-f902-466c-bfc7-a3aee30e299d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Getting quotas for user 3924bafb69cd45709eb3878837741eef and project f6e779f0506643d08d984c2971d5a71c. Resources: {'key_pairs'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:11:26.840471 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-cae5de2e-f902-466c-bfc7-a3aee30e299d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.148704 Nov 08 16:11:26.841815 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 20/38] 10.222.0.37 () {60 vars in 1157 bytes} [Mon Nov 8 16:11:25 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:27.115068 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-94a03a05-a847-4065-a784-088396e9ec25 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:27.115825 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-94a03a05-a847-4065-a784-088396e9ec25 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:27.135718 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-94a03a05-a847-4065-a784-088396e9ec25 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:27.141507 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-94a03a05-a847-4065-a784-088396e9ec25 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:27.144809 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-94a03a05-a847-4065-a784-088396e9ec25 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:27.145292 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-94a03a05-a847-4065-a784-088396e9ec25 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:27.339087 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-bb6f6f67-d66a-4a6b-b7a7-47c4d960016d req-7c6100f2-8b63-4d66-8cf1-170abb069769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfa35d29-db7d-4fab-a001-7db0d508d70a", "tag": "4020a644-ef2e-4dd8-931a-cfccef4e7b15"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:11:27.342346 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:11:27.342346 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:11:27.387989 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-bb6f6f67-d66a-4a6b-b7a7-47c4d960016d req-7c6100f2-8b63-4d66-8cf1-170abb069769 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:27.396096 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-bb6f6f67-d66a-4a6b-b7a7-47c4d960016d req-7c6100f2-8b63-4d66-8cf1-170abb069769 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:27.441967 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-bb6f6f67-d66a-4a6b-b7a7-47c4d960016d req-7c6100f2-8b63-4d66-8cf1-170abb069769 service nova] Creating event network-changed:4020a644-ef2e-4dd8-931a-cfccef4e7b15 for instance dfa35d29-db7d-4fab-a001-7db0d508d70a on hv-cinder-81618 Nov 08 16:11:27.442751 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-bb6f6f67-d66a-4a6b-b7a7-47c4d960016d req-7c6100f2-8b63-4d66-8cf1-170abb069769 service nova] Acquired lock "compute-rpcapi-router" {{(pid=115524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 08 16:11:27.444066 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ce5cfe19-ca95-4426-b1c6-435c6a7129e7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:27.445312 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ce5cfe19-ca95-4426-b1c6-435c6a7129e7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:27.446815 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ce5cfe19-ca95-4426-b1c6-435c6a7129e7 None None] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:27.447471 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ce5cfe19-ca95-4426-b1c6-435c6a7129e7 None None] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:27.457798 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.compute.rpcapi [None req-ce5cfe19-ca95-4426-b1c6-435c6a7129e7 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 08 16:11:27.459425 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ce5cfe19-ca95-4426-b1c6-435c6a7129e7 None None] Releasing lock "compute-rpcapi-router" {{(pid=115524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 08 16:11:27.516420 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ce5cfe19-ca95-4426-b1c6-435c6a7129e7 None None] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.752861 Nov 08 16:11:27.518410 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 19/39] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:11:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:11:27.532534 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3d3f1898-0704-4d27-a01a-67b6d6aa198a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:27.534318 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3d3f1898-0704-4d27-a01a-67b6d6aa198a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:27.550174 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3d3f1898-0704-4d27-a01a-67b6d6aa198a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:27.551083 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3d3f1898-0704-4d27-a01a-67b6d6aa198a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:27.552026 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3d3f1898-0704-4d27-a01a-67b6d6aa198a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:27.554498 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3d3f1898-0704-4d27-a01a-67b6d6aa198a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:27.676700 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-94a03a05-a847-4065-a784-088396e9ec25 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:27.686952 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-94a03a05-a847-4065-a784-088396e9ec25 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.575831 Nov 08 16:11:27.694322 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 21/40] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:27 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:27.775510 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a149dd1d-0db3-4b64-8d19-d7a2773d7c77 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:27.776465 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a149dd1d-0db3-4b64-8d19-d7a2773d7c77 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:27.794481 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a149dd1d-0db3-4b64-8d19-d7a2773d7c77 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:27.795191 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a149dd1d-0db3-4b64-8d19-d7a2773d7c77 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:27.796290 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a149dd1d-0db3-4b64-8d19-d7a2773d7c77 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:27.796931 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a149dd1d-0db3-4b64-8d19-d7a2773d7c77 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:27.834645 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-3d3f1898-0704-4d27-a01a-67b6d6aa198a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:27.844275 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-3d3f1898-0704-4d27-a01a-67b6d6aa198a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:27.855119 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-3d3f1898-0704-4d27-a01a-67b6d6aa198a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:27.859322 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3d3f1898-0704-4d27-a01a-67b6d6aa198a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1334 microversion: 2.20 time: 0.339132 Nov 08 16:11:27.870070 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 20/41] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:27 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1334 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:11:28.324520 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a149dd1d-0db3-4b64-8d19-d7a2773d7c77 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:28.331963 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a149dd1d-0db3-4b64-8d19-d7a2773d7c77 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.560617 Nov 08 16:11:28.338297 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 22/42] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:27 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:28.421192 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-876255908", "imageRef": "9abeafba-e602-4e0a-aab2-62160562de06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d5b5768-37f3-49a1-b451-2803f6f97429"}]}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:11:28.552861 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.network.neutron [None req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] validate_networks() for [('2d5b5768-37f3-49a1-b451-2803f6f97429', None, None, None, None, None)] {{(pid=115524) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:11:28.705204 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-38c5faa8-4a0e-4e70-96be-bba1ea6b2061 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:28.706455 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-38c5faa8-4a0e-4e70-96be-bba1ea6b2061 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:28.715794 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-38c5faa8-4a0e-4e70-96be-bba1ea6b2061 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:28.719613 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-38c5faa8-4a0e-4e70-96be-bba1ea6b2061 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:28.733882 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-38c5faa8-4a0e-4e70-96be-bba1ea6b2061 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:28.734517 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-38c5faa8-4a0e-4e70-96be-bba1ea6b2061 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:29.564912 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-38c5faa8-4a0e-4e70-96be-bba1ea6b2061 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:29.574248 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-38c5faa8-4a0e-4e70-96be-bba1ea6b2061 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.872734 Nov 08 16:11:29.574934 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 23/43] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:28 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:29.590468 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a0a272ea-f955-4b49-8f9f-724f8945ed68 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:29.591082 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a0a272ea-f955-4b49-8f9f-724f8945ed68 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:29.622746 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a0a272ea-f955-4b49-8f9f-724f8945ed68 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:29.623220 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a0a272ea-f955-4b49-8f9f-724f8945ed68 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:29.624301 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a0a272ea-f955-4b49-8f9f-724f8945ed68 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:29.624740 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a0a272ea-f955-4b49-8f9f-724f8945ed68 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:29.876064 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a0a272ea-f955-4b49-8f9f-724f8945ed68 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:29.896845 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a0a272ea-f955-4b49-8f9f-724f8945ed68 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:29.911047 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a0a272ea-f955-4b49-8f9f-724f8945ed68 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:29.912258 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a0a272ea-f955-4b49-8f9f-724f8945ed68 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1340 microversion: 2.20 time: 0.334636 Nov 08 16:11:29.915052 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 24/44] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:29 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1340 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:11:29.919789 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f0ab194a-3276-4858-b374-529c20a434d9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:29.921929 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f0ab194a-3276-4858-b374-529c20a434d9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:29.946759 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f0ab194a-3276-4858-b374-529c20a434d9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:29.948433 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f0ab194a-3276-4858-b374-529c20a434d9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:29.951285 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f0ab194a-3276-4858-b374-529c20a434d9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:29.953379 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f0ab194a-3276-4858-b374-529c20a434d9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:30.148139 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Flavor limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:11:30.149833 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Image limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:11:30.152743 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Flavor pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:11:30.154202 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Image pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:11:30.154660 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:11:30.176797 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:30.177261 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:30.178111 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:30.184193 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:30.217983 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Getting quotas for project 4818358a827143eb9ace58a26713cdf0. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:11:30.221680 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f0ab194a-3276-4858-b374-529c20a434d9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:30.224508 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Getting quotas for user db4a890d933f49c890a7d3788aa61706 and project 4818358a827143eb9ace58a26713cdf0. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:11:30.232395 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f0ab194a-3276-4858-b374-529c20a434d9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.314183 Nov 08 16:11:30.239501 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 25/45] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:29 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:30.250511 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Going to run 1 instances... {{(pid=115524) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:11:30.254595 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9abeafba-e602-4e0a-aab2-62160562de06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:11:30.258415 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-a790e770-4342-46ca-bf68-4f089a9a4601 req-3aeae958-c62c-4bc2-974b-3cf3f2988e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec4f96b9-4128-4da6-9880-95a0f72fd4e2", "tag": "70c72d16-a0e9-49bb-b7b8-ef436d81a390"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:11:30.263982 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:11:30.263982 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:11:30.287064 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-a790e770-4342-46ca-bf68-4f089a9a4601 req-3aeae958-c62c-4bc2-974b-3cf3f2988e15 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:30.288510 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-a790e770-4342-46ca-bf68-4f089a9a4601 req-3aeae958-c62c-4bc2-974b-3cf3f2988e15 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:30.325247 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-a790e770-4342-46ca-bf68-4f089a9a4601 req-3aeae958-c62c-4bc2-974b-3cf3f2988e15 service nova] Creating event network-changed:70c72d16-a0e9-49bb-b7b8-ef436d81a390 for instance ec4f96b9-4128-4da6-9880-95a0f72fd4e2 on hv-cinder-81618 Nov 08 16:11:30.326594 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-a790e770-4342-46ca-bf68-4f089a9a4601 req-3aeae958-c62c-4bc2-974b-3cf3f2988e15 service nova] Acquired lock "compute-rpcapi-router" {{(pid=115523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 08 16:11:30.328304 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-42aa1409-1712-4e10-a82b-c202b0ed5583 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:30.328949 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-42aa1409-1712-4e10-a82b-c202b0ed5583 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:30.330025 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-42aa1409-1712-4e10-a82b-c202b0ed5583 None None] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:30.330648 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-42aa1409-1712-4e10-a82b-c202b0ed5583 None None] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:30.343562 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.compute.rpcapi [None req-42aa1409-1712-4e10-a82b-c202b0ed5583 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 08 16:11:30.346304 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-42aa1409-1712-4e10-a82b-c202b0ed5583 None None] Releasing lock "compute-rpcapi-router" {{(pid=115523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 08 16:11:30.348310 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.136548 Nov 08 16:11:30.359742 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 21/46] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Nov 8 16:11:28 2021] POST /compute/v2.1/servers => generated 383 bytes in 2148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 16:11:30.374866 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9c38e397-b129-4e08-89bf-cbc973147607 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:30.376881 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9c38e397-b129-4e08-89bf-cbc973147607 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:30.414356 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-42aa1409-1712-4e10-a82b-c202b0ed5583 None None] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173439 Nov 08 16:11:30.416214 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 26/47] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:11:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:11:30.493163 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-9c38e397-b129-4e08-89bf-cbc973147607 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:30.501369 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9c38e397-b129-4e08-89bf-cbc973147607 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1221 microversion: 2.1 time: 0.140478 Nov 08 16:11:30.505691 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 22/48] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:30 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1221 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:30.591590 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a97888fd-f08f-4a22-83fa-4ce410ee6541 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:30.592289 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a97888fd-f08f-4a22-83fa-4ce410ee6541 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:30.604910 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a97888fd-f08f-4a22-83fa-4ce410ee6541 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:30.605697 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a97888fd-f08f-4a22-83fa-4ce410ee6541 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:30.608896 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a97888fd-f08f-4a22-83fa-4ce410ee6541 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:30.609818 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a97888fd-f08f-4a22-83fa-4ce410ee6541 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:30.703327 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1870393347", "imageRef": "9abeafba-e602-4e0a-aab2-62160562de06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d5b5768-37f3-49a1-b451-2803f6f97429"}]}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:11:30.777504 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.network.neutron [None req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] validate_networks() for [('2d5b5768-37f3-49a1-b451-2803f6f97429', None, None, None, None, None)] {{(pid=115524) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:11:31.056657 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a97888fd-f08f-4a22-83fa-4ce410ee6541 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:31.064277 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a97888fd-f08f-4a22-83fa-4ce410ee6541 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.476933 Nov 08 16:11:31.064943 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 27/49] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:30 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:31.071364 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-99872488-7883-43fb-a390-5dfc4de3840c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:31.072217 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-99872488-7883-43fb-a390-5dfc4de3840c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:31.079860 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-99872488-7883-43fb-a390-5dfc4de3840c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:31.080631 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-99872488-7883-43fb-a390-5dfc4de3840c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:31.081488 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-99872488-7883-43fb-a390-5dfc4de3840c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:31.082011 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-99872488-7883-43fb-a390-5dfc4de3840c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:31.206500 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-99872488-7883-43fb-a390-5dfc4de3840c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:31.217089 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-99872488-7883-43fb-a390-5dfc4de3840c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:31.220859 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-99872488-7883-43fb-a390-5dfc4de3840c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:31.223797 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-99872488-7883-43fb-a390-5dfc4de3840c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1340 microversion: 2.20 time: 0.155975 Nov 08 16:11:31.243598 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 28/50] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:31 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1340 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:11:31.268732 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ebe8eb2c-4932-40f2-b4b3-c982c2216f66 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:31.272237 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ebe8eb2c-4932-40f2-b4b3-c982c2216f66 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:31.280211 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ebe8eb2c-4932-40f2-b4b3-c982c2216f66 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:31.280875 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ebe8eb2c-4932-40f2-b4b3-c982c2216f66 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:31.281878 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ebe8eb2c-4932-40f2-b4b3-c982c2216f66 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:31.282603 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ebe8eb2c-4932-40f2-b4b3-c982c2216f66 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:31.605011 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ebe8eb2c-4932-40f2-b4b3-c982c2216f66 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:31.612115 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ebe8eb2c-4932-40f2-b4b3-c982c2216f66 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.366337 Nov 08 16:11:31.612676 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 29/51] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:31 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:31.655274 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-489687994", "imageRef": "9abeafba-e602-4e0a-aab2-62160562de06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75fa9c3e-7bfe-490a-9118-221394c29646"}], "security_groups": [{"name": "tempest-securitygroup--843466784"}], "key_name": "tempest-keypair-1447147253", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:11:31.668195 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Flavor limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:11:31.668680 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Image limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:11:31.669239 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Flavor pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:11:31.669655 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Image pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:11:31.670099 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:11:31.682074 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:31.684389 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:31.685662 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:31.686130 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:31.706155 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Getting quotas for project 4818358a827143eb9ace58a26713cdf0. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:11:31.711453 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Getting quotas for user db4a890d933f49c890a7d3788aa61706 and project 4818358a827143eb9ace58a26713cdf0. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:11:31.723900 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Going to run 1 instances... {{(pid=115524) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:11:31.727501 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9abeafba-e602-4e0a-aab2-62160562de06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:11:31.779578 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.network.neutron [None req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] validate_networks() for [('75fa9c3e-7bfe-490a-9118-221394c29646', None, None, None, None, None)] {{(pid=115523) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:11:31.785355 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.091928 Nov 08 16:11:31.786303 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 23/52] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Nov 8 16:11:30 2021] POST /compute/v2.1/servers => generated 383 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 16:11:31.797745 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ca3cd31c-3c43-4c06-ae38-88852b205ae1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:31.798639 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ca3cd31c-3c43-4c06-ae38-88852b205ae1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:31.900695 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-ca3cd31c-3c43-4c06-ae38-88852b205ae1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:31.907875 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ca3cd31c-3c43-4c06-ae38-88852b205ae1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1222 microversion: 2.1 time: 0.115077 Nov 08 16:11:31.908780 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 24/53] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:31 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1222 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:32.089989 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-598fb43d-0f0a-4fc8-8d4a-5ea730cd2819 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:32.090658 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-598fb43d-0f0a-4fc8-8d4a-5ea730cd2819 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:32.111393 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-598fb43d-0f0a-4fc8-8d4a-5ea730cd2819 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:32.111858 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-598fb43d-0f0a-4fc8-8d4a-5ea730cd2819 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:32.112655 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-598fb43d-0f0a-4fc8-8d4a-5ea730cd2819 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:32.113252 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-598fb43d-0f0a-4fc8-8d4a-5ea730cd2819 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:32.510605 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-598fb43d-0f0a-4fc8-8d4a-5ea730cd2819 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:32.518110 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-598fb43d-0f0a-4fc8-8d4a-5ea730cd2819 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.441555 Nov 08 16:11:32.518681 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 25/54] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:32 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:32.520435 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Flavor limits 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:11:32.520915 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Image limits 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:11:32.521466 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Flavor pref 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:11:32.522068 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Image pref 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:11:32.523339 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:11:32.525191 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a6299bf6-84d4-4a7d-be17-6f68b39ad6a6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:32.525933 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a6299bf6-84d4-4a7d-be17-6f68b39ad6a6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:32.536672 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a6299bf6-84d4-4a7d-be17-6f68b39ad6a6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:32.537207 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a6299bf6-84d4-4a7d-be17-6f68b39ad6a6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:32.538433 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a6299bf6-84d4-4a7d-be17-6f68b39ad6a6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:32.538940 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a6299bf6-84d4-4a7d-be17-6f68b39ad6a6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:32.539236 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:32.539863 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:32.540829 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:32.541485 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:32.566032 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Getting quotas for project f6e779f0506643d08d984c2971d5a71c. Resources: {'instances', 'ram', 'cores'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:11:32.570727 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Getting quotas for user 3924bafb69cd45709eb3878837741eef and project f6e779f0506643d08d984c2971d5a71c. Resources: {'instances', 'ram', 'cores'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:11:32.583087 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Going to run 1 instances... {{(pid=115523) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:11:32.585458 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9abeafba-e602-4e0a-aab2-62160562de06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:11:32.613756 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a6299bf6-84d4-4a7d-be17-6f68b39ad6a6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:32.627134 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a6299bf6-84d4-4a7d-be17-6f68b39ad6a6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:32.628787 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a6299bf6-84d4-4a7d-be17-6f68b39ad6a6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:32.629940 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a6299bf6-84d4-4a7d-be17-6f68b39ad6a6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1340 microversion: 2.20 time: 0.110019 Nov 08 16:11:32.630788 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 26/55] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:32 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1340 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:11:32.635078 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f38f1053-1a26-4890-8991-67f87df7cc54 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:32.635691 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f38f1053-1a26-4890-8991-67f87df7cc54 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:32.642135 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f38f1053-1a26-4890-8991-67f87df7cc54 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:32.642806 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f38f1053-1a26-4890-8991-67f87df7cc54 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:32.643458 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.993715 Nov 08 16:11:32.643918 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f38f1053-1a26-4890-8991-67f87df7cc54 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:32.644545 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f38f1053-1a26-4890-8991-67f87df7cc54 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:32.644712 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 30/56] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Nov 8 16:11:31 2021] POST /compute/v2.1/servers => generated 401 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 08 16:11:32.654579 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-56094376-b6fd-4a4f-aa34-615cc117044d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:32.655410 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-56094376-b6fd-4a4f-aa34-615cc117044d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:32.746949 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-56094376-b6fd-4a4f-aa34-615cc117044d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:32.756633 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-56094376-b6fd-4a4f-aa34-615cc117044d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1237 microversion: 2.1 time: 0.105714 Nov 08 16:11:32.757211 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 31/57] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:32 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1237 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:32.925183 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-64c2c007-39f6-4991-9708-feeff2aa9aef tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:32.927105 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-64c2c007-39f6-4991-9708-feeff2aa9aef tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:32.935739 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-64c2c007-39f6-4991-9708-feeff2aa9aef tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:32.936502 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-64c2c007-39f6-4991-9708-feeff2aa9aef tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:32.937670 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-64c2c007-39f6-4991-9708-feeff2aa9aef tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:32.938160 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-64c2c007-39f6-4991-9708-feeff2aa9aef tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:33.014859 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f38f1053-1a26-4890-8991-67f87df7cc54 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:33.022768 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f38f1053-1a26-4890-8991-67f87df7cc54 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.390857 Nov 08 16:11:33.023739 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 27/58] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:32 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:33.047054 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-64c2c007-39f6-4991-9708-feeff2aa9aef tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:33.055332 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-64c2c007-39f6-4991-9708-feeff2aa9aef tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1226 microversion: 2.1 time: 0.134161 Nov 08 16:11:33.056446 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 32/59] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:32 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1226 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:33.535051 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-aaceb25c-ea1a-4ea4-8060-65b6eb760528 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:33.535696 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-aaceb25c-ea1a-4ea4-8060-65b6eb760528 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:33.541598 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-aaceb25c-ea1a-4ea4-8060-65b6eb760528 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:33.542071 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-aaceb25c-ea1a-4ea4-8060-65b6eb760528 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:33.542829 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-aaceb25c-ea1a-4ea4-8060-65b6eb760528 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:33.543272 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-aaceb25c-ea1a-4ea4-8060-65b6eb760528 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:33.648185 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8dd8df66-b380-4f07-9080-8c4e220436a7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:33.648890 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8dd8df66-b380-4f07-9080-8c4e220436a7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:33.654667 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8dd8df66-b380-4f07-9080-8c4e220436a7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:33.655101 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8dd8df66-b380-4f07-9080-8c4e220436a7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:33.655853 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8dd8df66-b380-4f07-9080-8c4e220436a7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:33.656272 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8dd8df66-b380-4f07-9080-8c4e220436a7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:33.670412 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-aaceb25c-ea1a-4ea4-8060-65b6eb760528 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:33.677494 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-aaceb25c-ea1a-4ea4-8060-65b6eb760528 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.146161 Nov 08 16:11:33.679557 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 28/60] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:33 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:33.774414 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-df261982-f36b-48b8-98ff-db1dbd00867d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:33.775023 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-df261982-f36b-48b8-98ff-db1dbd00867d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:33.780796 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-df261982-f36b-48b8-98ff-db1dbd00867d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:33.781241 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-df261982-f36b-48b8-98ff-db1dbd00867d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:33.782083 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-df261982-f36b-48b8-98ff-db1dbd00867d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:33.782524 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-df261982-f36b-48b8-98ff-db1dbd00867d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:33.785245 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8dd8df66-b380-4f07-9080-8c4e220436a7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:33.793184 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8dd8df66-b380-4f07-9080-8c4e220436a7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:33.794756 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8dd8df66-b380-4f07-9080-8c4e220436a7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:33.795851 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8dd8df66-b380-4f07-9080-8c4e220436a7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.152057 Nov 08 16:11:33.796411 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 33/61] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:33 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:11:33.840089 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-df261982-f36b-48b8-98ff-db1dbd00867d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:33.847148 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-df261982-f36b-48b8-98ff-db1dbd00867d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1241 microversion: 2.1 time: 0.076933 Nov 08 16:11:33.847715 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 29/62] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:33 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:34.039876 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-cceebad0-bcdb-4143-aae5-cabb3945e2f7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:34.040474 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-cceebad0-bcdb-4143-aae5-cabb3945e2f7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:34.046309 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cceebad0-bcdb-4143-aae5-cabb3945e2f7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:34.046749 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cceebad0-bcdb-4143-aae5-cabb3945e2f7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:34.047502 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cceebad0-bcdb-4143-aae5-cabb3945e2f7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:34.047926 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cceebad0-bcdb-4143-aae5-cabb3945e2f7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:34.074345 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-dfb428da-5674-463d-8917-9a6ca0b45c9f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:34.075096 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-dfb428da-5674-463d-8917-9a6ca0b45c9f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:34.086471 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dfb428da-5674-463d-8917-9a6ca0b45c9f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:34.087170 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dfb428da-5674-463d-8917-9a6ca0b45c9f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:34.088035 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dfb428da-5674-463d-8917-9a6ca0b45c9f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:34.088467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dfb428da-5674-463d-8917-9a6ca0b45c9f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:34.161779 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-dfb428da-5674-463d-8917-9a6ca0b45c9f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:34.170841 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-dfb428da-5674-463d-8917-9a6ca0b45c9f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1226 microversion: 2.1 time: 0.101481 Nov 08 16:11:34.171416 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 30/63] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:34 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:34.208167 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-cceebad0-bcdb-4143-aae5-cabb3945e2f7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:34.215910 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-cceebad0-bcdb-4143-aae5-cabb3945e2f7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.179683 Nov 08 16:11:34.216489 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 34/64] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:34 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:34.693615 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-44b66aa1-ee83-4c15-bcb3-fdda07e0f9cf tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:34.695000 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-44b66aa1-ee83-4c15-bcb3-fdda07e0f9cf tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:34.701740 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-44b66aa1-ee83-4c15-bcb3-fdda07e0f9cf tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:34.702445 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-44b66aa1-ee83-4c15-bcb3-fdda07e0f9cf tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:34.703378 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-44b66aa1-ee83-4c15-bcb3-fdda07e0f9cf tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:34.704727 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-44b66aa1-ee83-4c15-bcb3-fdda07e0f9cf tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:34.820081 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-64a97f55-7574-4c97-9316-ff204d342d42 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:34.822930 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-64a97f55-7574-4c97-9316-ff204d342d42 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:34.832959 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-64a97f55-7574-4c97-9316-ff204d342d42 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:34.833673 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-64a97f55-7574-4c97-9316-ff204d342d42 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:34.834609 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-64a97f55-7574-4c97-9316-ff204d342d42 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:34.835235 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-64a97f55-7574-4c97-9316-ff204d342d42 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:34.971357 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-44b66aa1-ee83-4c15-bcb3-fdda07e0f9cf tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:34.981156 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-44b66aa1-ee83-4c15-bcb3-fdda07e0f9cf tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.291162 Nov 08 16:11:34.982466 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 31/65] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:34 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:34.987888 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-8995b8ba-12fa-42f6-a3d8-57f91d113f0f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:34.988737 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-8995b8ba-12fa-42f6-a3d8-57f91d113f0f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:34.996072 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8995b8ba-12fa-42f6-a3d8-57f91d113f0f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:34.998538 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8995b8ba-12fa-42f6-a3d8-57f91d113f0f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:35.001310 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8995b8ba-12fa-42f6-a3d8-57f91d113f0f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:35.002374 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8995b8ba-12fa-42f6-a3d8-57f91d113f0f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:35.255027 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-8995b8ba-12fa-42f6-a3d8-57f91d113f0f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:35.265753 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-8995b8ba-12fa-42f6-a3d8-57f91d113f0f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1233 microversion: 2.1 time: 0.281883 Nov 08 16:11:35.279864 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 32/66] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:34 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1233 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:35.290711 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c7bf4467-19c3-49d3-97f3-7bec1a39d118 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:35.291330 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c7bf4467-19c3-49d3-97f3-7bec1a39d118 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:35.291636 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-64a97f55-7574-4c97-9316-ff204d342d42 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:35.300386 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-64a97f55-7574-4c97-9316-ff204d342d42 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:35.301931 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-64a97f55-7574-4c97-9316-ff204d342d42 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:35.307255 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c7bf4467-19c3-49d3-97f3-7bec1a39d118 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:35.309515 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c7bf4467-19c3-49d3-97f3-7bec1a39d118 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:35.311400 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c7bf4467-19c3-49d3-97f3-7bec1a39d118 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:35.311847 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c7bf4467-19c3-49d3-97f3-7bec1a39d118 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:35.316973 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-64a97f55-7574-4c97-9316-ff204d342d42 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.505577 Nov 08 16:11:35.328239 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 35/67] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:34 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:11:35.342444 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8b66744c-a453-4f9b-af0d-1794ed7e0a61 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:35.343061 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8b66744c-a453-4f9b-af0d-1794ed7e0a61 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:35.358638 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8b66744c-a453-4f9b-af0d-1794ed7e0a61 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:35.359326 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8b66744c-a453-4f9b-af0d-1794ed7e0a61 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:35.360280 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8b66744c-a453-4f9b-af0d-1794ed7e0a61 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:35.360857 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8b66744c-a453-4f9b-af0d-1794ed7e0a61 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:35.446882 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c7bf4467-19c3-49d3-97f3-7bec1a39d118 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:35.458851 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c7bf4467-19c3-49d3-97f3-7bec1a39d118 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1274 microversion: 2.1 time: 0.176401 Nov 08 16:11:35.462622 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 33/68] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:35 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1274 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:35.630615 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8b66744c-a453-4f9b-af0d-1794ed7e0a61 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:35.639467 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8b66744c-a453-4f9b-af0d-1794ed7e0a61 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.310091 Nov 08 16:11:35.640216 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 36/69] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:35 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:36.000204 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3e08899e-8a9a-432b-a21a-8345dc715e40 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:36.000880 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3e08899e-8a9a-432b-a21a-8345dc715e40 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:36.016641 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3e08899e-8a9a-432b-a21a-8345dc715e40 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:36.017085 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3e08899e-8a9a-432b-a21a-8345dc715e40 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:36.017905 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3e08899e-8a9a-432b-a21a-8345dc715e40 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:36.018726 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3e08899e-8a9a-432b-a21a-8345dc715e40 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:36.189196 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-f493bbcd-e014-4edc-affd-4f127802b5c4 req-6d79e4db-a39a-4df6-bb59-6bdda4a1119e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:11:36.190957 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:11:36.190957 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:11:36.213015 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-f493bbcd-e014-4edc-affd-4f127802b5c4 req-6d79e4db-a39a-4df6-bb59-6bdda4a1119e service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:36.214633 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-f493bbcd-e014-4edc-affd-4f127802b5c4 req-6d79e4db-a39a-4df6-bb59-6bdda4a1119e service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:36.245567 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-f493bbcd-e014-4edc-affd-4f127802b5c4 req-6d79e4db-a39a-4df6-bb59-6bdda4a1119e service nova] Creating event network-changed:fbefda08-fc7a-42a0-b714-6dea3d8a5161 for instance 1c1c8c8d-5f78-45fb-803d-8f7a84df3433 on hv-cinder-81618 Nov 08 16:11:36.252115 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-f493bbcd-e014-4edc-affd-4f127802b5c4 req-6d79e4db-a39a-4df6-bb59-6bdda4a1119e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204472 Nov 08 16:11:36.253484 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 37/70] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:11:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:11:36.287660 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e47068c0-e022-44b2-993e-0f1ae2febbf8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:36.289047 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e47068c0-e022-44b2-993e-0f1ae2febbf8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:36.298100 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e47068c0-e022-44b2-993e-0f1ae2febbf8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:36.298532 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e47068c0-e022-44b2-993e-0f1ae2febbf8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:36.299791 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e47068c0-e022-44b2-993e-0f1ae2febbf8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:36.300418 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e47068c0-e022-44b2-993e-0f1ae2febbf8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:36.392569 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-e47068c0-e022-44b2-993e-0f1ae2febbf8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:36.396685 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-3e08899e-8a9a-432b-a21a-8345dc715e40 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:36.403477 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e47068c0-e022-44b2-993e-0f1ae2febbf8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1289 microversion: 2.1 time: 0.120590 Nov 08 16:11:36.404284 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 38/71] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:36 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1289 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:36.409310 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-2b303cec-9cd5-479f-9b78-1e8226a34f0c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:36.410171 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-2b303cec-9cd5-479f-9b78-1e8226a34f0c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:36.421587 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2b303cec-9cd5-479f-9b78-1e8226a34f0c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:36.422310 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2b303cec-9cd5-479f-9b78-1e8226a34f0c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:36.424087 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2b303cec-9cd5-479f-9b78-1e8226a34f0c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:36.425332 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2b303cec-9cd5-479f-9b78-1e8226a34f0c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:36.427578 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3e08899e-8a9a-432b-a21a-8345dc715e40 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.432895 Nov 08 16:11:36.430995 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 34/72] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:35 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:36.477445 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2907f55c-0cce-4855-a913-3d5b769f5ba9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:36.477987 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2907f55c-0cce-4855-a913-3d5b769f5ba9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:36.486752 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2907f55c-0cce-4855-a913-3d5b769f5ba9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:36.489426 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2907f55c-0cce-4855-a913-3d5b769f5ba9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:36.497734 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2907f55c-0cce-4855-a913-3d5b769f5ba9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:36.498496 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2907f55c-0cce-4855-a913-3d5b769f5ba9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:36.687338 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-2907f55c-0cce-4855-a913-3d5b769f5ba9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:36.701178 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2907f55c-0cce-4855-a913-3d5b769f5ba9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1280 microversion: 2.1 time: 0.228221 Nov 08 16:11:36.718187 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 35/73] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:36 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1280 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:36.730490 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b432d875-9e0a-403f-a7b2-14dbdb4cdd12 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:36.731053 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b432d875-9e0a-403f-a7b2-14dbdb4cdd12 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:36.738866 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b432d875-9e0a-403f-a7b2-14dbdb4cdd12 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:36.739610 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b432d875-9e0a-403f-a7b2-14dbdb4cdd12 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:36.741895 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b432d875-9e0a-403f-a7b2-14dbdb4cdd12 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:36.744058 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b432d875-9e0a-403f-a7b2-14dbdb4cdd12 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:36.896563 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-2b303cec-9cd5-479f-9b78-1e8226a34f0c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:36.904613 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-2b303cec-9cd5-479f-9b78-1e8226a34f0c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:36.906469 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-2b303cec-9cd5-479f-9b78-1e8226a34f0c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:36.907608 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-2b303cec-9cd5-479f-9b78-1e8226a34f0c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.502177 Nov 08 16:11:36.908668 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 39/74] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:36 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:11:36.989516 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b432d875-9e0a-403f-a7b2-14dbdb4cdd12 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:37.004196 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b432d875-9e0a-403f-a7b2-14dbdb4cdd12 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.284841 Nov 08 16:11:37.004768 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 36/75] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:36 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:37.414453 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-9d4268f0-834e-4efd-8065-04f0d0794a61 req-90a78005-7572-48e5-98f6-d6a90c6ca70f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f7e3a8-0064-42ad-9e41-03a1ba050703", "tag": "17db566c-bf28-4091-b7f6-4ffa5f80c982"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:11:37.416006 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:11:37.416006 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:11:37.420158 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-dc52a50c-c467-42db-ac5e-4044dd242059 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:37.420843 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-dc52a50c-c467-42db-ac5e-4044dd242059 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:37.423147 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-9d4268f0-834e-4efd-8065-04f0d0794a61 req-90a78005-7572-48e5-98f6-d6a90c6ca70f service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:37.423587 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-9d4268f0-834e-4efd-8065-04f0d0794a61 req-90a78005-7572-48e5-98f6-d6a90c6ca70f service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:37.427180 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dc52a50c-c467-42db-ac5e-4044dd242059 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:37.427700 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dc52a50c-c467-42db-ac5e-4044dd242059 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:37.429404 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dc52a50c-c467-42db-ac5e-4044dd242059 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:37.429974 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dc52a50c-c467-42db-ac5e-4044dd242059 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:37.435221 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-9d4268f0-834e-4efd-8065-04f0d0794a61 req-90a78005-7572-48e5-98f6-d6a90c6ca70f service nova] Creating event network-changed:17db566c-bf28-4091-b7f6-4ffa5f80c982 for instance 44f7e3a8-0064-42ad-9e41-03a1ba050703 on hv-cinder-81618 Nov 08 16:11:37.440038 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-9d4268f0-834e-4efd-8065-04f0d0794a61 req-90a78005-7572-48e5-98f6-d6a90c6ca70f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029600 Nov 08 16:11:37.442192 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 40/76] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:11:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:11:37.453065 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-03d75cd9-4801-47b3-b72c-d9ab589fc479 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:37.453966 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-03d75cd9-4801-47b3-b72c-d9ab589fc479 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:37.460384 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-03d75cd9-4801-47b3-b72c-d9ab589fc479 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:37.460836 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-03d75cd9-4801-47b3-b72c-d9ab589fc479 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:37.461835 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-03d75cd9-4801-47b3-b72c-d9ab589fc479 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:37.462318 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-03d75cd9-4801-47b3-b72c-d9ab589fc479 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:37.492245 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-dc52a50c-c467-42db-ac5e-4044dd242059 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:37.500302 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-dc52a50c-c467-42db-ac5e-4044dd242059 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1295 microversion: 2.1 time: 0.083867 Nov 08 16:11:37.505977 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 37/77] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:37 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1295 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:37.602450 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-03d75cd9-4801-47b3-b72c-d9ab589fc479 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:37.609574 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-03d75cd9-4801-47b3-b72c-d9ab589fc479 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.166135 Nov 08 16:11:37.610166 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 41/78] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:37 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:37.717482 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c4d84187-e63b-4328-85ba-596a998ac7c1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:37.718110 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c4d84187-e63b-4328-85ba-596a998ac7c1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:37.723952 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c4d84187-e63b-4328-85ba-596a998ac7c1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:37.724401 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c4d84187-e63b-4328-85ba-596a998ac7c1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:37.725159 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c4d84187-e63b-4328-85ba-596a998ac7c1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:37.725588 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c4d84187-e63b-4328-85ba-596a998ac7c1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:37.852534 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c4d84187-e63b-4328-85ba-596a998ac7c1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:37.859685 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c4d84187-e63b-4328-85ba-596a998ac7c1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.145838 Nov 08 16:11:37.860242 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 38/79] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:37 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:37.925769 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0cd067a3-f473-483e-9953-7efd3efca91b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:37.926364 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0cd067a3-f473-483e-9953-7efd3efca91b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:37.932665 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0cd067a3-f473-483e-9953-7efd3efca91b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:37.933098 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0cd067a3-f473-483e-9953-7efd3efca91b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:37.933874 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0cd067a3-f473-483e-9953-7efd3efca91b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:37.934300 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0cd067a3-f473-483e-9953-7efd3efca91b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:38.021288 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1130417b-c384-4dff-b212-afa2adeba33f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:38.021917 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1130417b-c384-4dff-b212-afa2adeba33f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:38.027709 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1130417b-c384-4dff-b212-afa2adeba33f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:38.028146 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1130417b-c384-4dff-b212-afa2adeba33f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:38.029110 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1130417b-c384-4dff-b212-afa2adeba33f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:38.029537 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1130417b-c384-4dff-b212-afa2adeba33f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:38.062282 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0cd067a3-f473-483e-9953-7efd3efca91b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:38.070443 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0cd067a3-f473-483e-9953-7efd3efca91b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:38.072237 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0cd067a3-f473-483e-9953-7efd3efca91b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:38.073553 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0cd067a3-f473-483e-9953-7efd3efca91b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.151547 Nov 08 16:11:38.074645 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 42/80] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:37 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:11:38.182924 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1130417b-c384-4dff-b212-afa2adeba33f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:38.190134 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1130417b-c384-4dff-b212-afa2adeba33f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.172572 Nov 08 16:11:38.190695 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 39/81] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:38 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:38.517199 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0ff8e280-064f-4227-9ac9-cc1c0c678886 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:38.517866 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0ff8e280-064f-4227-9ac9-cc1c0c678886 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:38.523838 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0ff8e280-064f-4227-9ac9-cc1c0c678886 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:38.524281 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0ff8e280-064f-4227-9ac9-cc1c0c678886 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:38.525043 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0ff8e280-064f-4227-9ac9-cc1c0c678886 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:38.525472 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0ff8e280-064f-4227-9ac9-cc1c0c678886 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:38.583379 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0ff8e280-064f-4227-9ac9-cc1c0c678886 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:38.590564 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0ff8e280-064f-4227-9ac9-cc1c0c678886 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1295 microversion: 2.1 time: 0.077014 Nov 08 16:11:38.591130 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 43/82] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:38 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1295 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:38.626641 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0a7dc5d1-2c42-4b44-be31-292cdbf253e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:38.627243 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0a7dc5d1-2c42-4b44-be31-292cdbf253e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:38.633736 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0a7dc5d1-2c42-4b44-be31-292cdbf253e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:38.634184 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0a7dc5d1-2c42-4b44-be31-292cdbf253e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:38.634946 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0a7dc5d1-2c42-4b44-be31-292cdbf253e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:38.635377 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0a7dc5d1-2c42-4b44-be31-292cdbf253e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:38.759815 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0a7dc5d1-2c42-4b44-be31-292cdbf253e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:38.766924 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0a7dc5d1-2c42-4b44-be31-292cdbf253e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.144126 Nov 08 16:11:38.767479 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 40/83] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:38 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:38.876306 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f10f3973-3bac-46d0-a1b7-7fe08097e19e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:38.876909 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f10f3973-3bac-46d0-a1b7-7fe08097e19e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:38.883248 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f10f3973-3bac-46d0-a1b7-7fe08097e19e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:38.883692 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f10f3973-3bac-46d0-a1b7-7fe08097e19e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:38.884484 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f10f3973-3bac-46d0-a1b7-7fe08097e19e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:38.884915 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f10f3973-3bac-46d0-a1b7-7fe08097e19e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:39.092006 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-47b842df-95ea-453a-9b37-8f78c3ed0259 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:39.092614 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-47b842df-95ea-453a-9b37-8f78c3ed0259 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:39.098683 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-47b842df-95ea-453a-9b37-8f78c3ed0259 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:39.099133 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-47b842df-95ea-453a-9b37-8f78c3ed0259 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:39.099910 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-47b842df-95ea-453a-9b37-8f78c3ed0259 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:39.100346 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-47b842df-95ea-453a-9b37-8f78c3ed0259 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:39.156238 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f10f3973-3bac-46d0-a1b7-7fe08097e19e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:39.163405 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f10f3973-3bac-46d0-a1b7-7fe08097e19e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.291027 Nov 08 16:11:39.163972 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 44/84] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:38 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:39.206937 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-cb8f1824-3095-41f6-8fdf-5a5a7bc726c6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:39.207540 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-cb8f1824-3095-41f6-8fdf-5a5a7bc726c6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:39.213270 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cb8f1824-3095-41f6-8fdf-5a5a7bc726c6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:39.213727 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cb8f1824-3095-41f6-8fdf-5a5a7bc726c6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:39.214550 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cb8f1824-3095-41f6-8fdf-5a5a7bc726c6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:39.214930 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cb8f1824-3095-41f6-8fdf-5a5a7bc726c6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:39.236401 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-47b842df-95ea-453a-9b37-8f78c3ed0259 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:39.244757 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-47b842df-95ea-453a-9b37-8f78c3ed0259 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:39.246405 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-47b842df-95ea-453a-9b37-8f78c3ed0259 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:39.247549 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-47b842df-95ea-453a-9b37-8f78c3ed0259 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.159277 Nov 08 16:11:39.248117 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 41/85] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:39 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:11:39.344400 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-cb8f1824-3095-41f6-8fdf-5a5a7bc726c6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:39.351469 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-cb8f1824-3095-41f6-8fdf-5a5a7bc726c6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.148106 Nov 08 16:11:39.352025 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 45/86] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:39 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:39.607041 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4b7e8609-7090-45c1-bf2c-e06cb17d48b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:39.607645 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4b7e8609-7090-45c1-bf2c-e06cb17d48b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:39.613464 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b7e8609-7090-45c1-bf2c-e06cb17d48b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:39.613958 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b7e8609-7090-45c1-bf2c-e06cb17d48b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:39.614723 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b7e8609-7090-45c1-bf2c-e06cb17d48b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:39.615155 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b7e8609-7090-45c1-bf2c-e06cb17d48b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:39.672435 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4b7e8609-7090-45c1-bf2c-e06cb17d48b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:39.680102 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4b7e8609-7090-45c1-bf2c-e06cb17d48b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1295 microversion: 2.1 time: 0.076662 Nov 08 16:11:39.680663 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 42/87] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:39 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1295 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:39.783250 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a3d32793-40cc-4c73-8ab7-d83f00837a15 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:39.783856 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a3d32793-40cc-4c73-8ab7-d83f00837a15 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:39.789776 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a3d32793-40cc-4c73-8ab7-d83f00837a15 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:39.790226 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a3d32793-40cc-4c73-8ab7-d83f00837a15 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:39.790990 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a3d32793-40cc-4c73-8ab7-d83f00837a15 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:39.791420 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a3d32793-40cc-4c73-8ab7-d83f00837a15 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:39.922039 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a3d32793-40cc-4c73-8ab7-d83f00837a15 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:39.929632 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a3d32793-40cc-4c73-8ab7-d83f00837a15 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.149992 Nov 08 16:11:39.930216 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 46/88] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:39 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:40.179814 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7f227ff0-fe29-4a85-bb6a-ea199626002b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:40.180761 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7f227ff0-fe29-4a85-bb6a-ea199626002b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:40.186742 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7f227ff0-fe29-4a85-bb6a-ea199626002b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:40.187188 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7f227ff0-fe29-4a85-bb6a-ea199626002b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:40.187956 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7f227ff0-fe29-4a85-bb6a-ea199626002b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:40.188388 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7f227ff0-fe29-4a85-bb6a-ea199626002b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:40.266583 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-65f69024-27dd-48b3-8ab1-bb1329688361 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:40.267250 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-65f69024-27dd-48b3-8ab1-bb1329688361 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:40.273394 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-65f69024-27dd-48b3-8ab1-bb1329688361 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:40.273961 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-65f69024-27dd-48b3-8ab1-bb1329688361 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:40.274809 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-65f69024-27dd-48b3-8ab1-bb1329688361 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:40.275299 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-65f69024-27dd-48b3-8ab1-bb1329688361 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:40.327018 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7f227ff0-fe29-4a85-bb6a-ea199626002b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:40.334189 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7f227ff0-fe29-4a85-bb6a-ea199626002b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.158629 Nov 08 16:11:40.334751 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 43/89] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:40 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:40.368246 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9ad39f34-8fb6-4599-886d-fb8e8bd8b4f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:40.368981 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9ad39f34-8fb6-4599-886d-fb8e8bd8b4f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:40.376014 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ad39f34-8fb6-4599-886d-fb8e8bd8b4f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:40.376499 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ad39f34-8fb6-4599-886d-fb8e8bd8b4f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:40.377245 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ad39f34-8fb6-4599-886d-fb8e8bd8b4f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:40.377891 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ad39f34-8fb6-4599-886d-fb8e8bd8b4f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:40.416587 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-65f69024-27dd-48b3-8ab1-bb1329688361 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:40.424167 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-65f69024-27dd-48b3-8ab1-bb1329688361 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:40.425641 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-65f69024-27dd-48b3-8ab1-bb1329688361 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:40.426773 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-65f69024-27dd-48b3-8ab1-bb1329688361 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.164091 Nov 08 16:11:40.427325 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 47/90] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:40 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:11:40.508815 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-9ad39f34-8fb6-4599-886d-fb8e8bd8b4f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:40.515989 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9ad39f34-8fb6-4599-886d-fb8e8bd8b4f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.151774 Nov 08 16:11:40.516536 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 44/91] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:40 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:40.696298 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-84cfafce-d006-492d-9bcc-4e4f28422b83 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:40.696897 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-84cfafce-d006-492d-9bcc-4e4f28422b83 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:40.703087 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84cfafce-d006-492d-9bcc-4e4f28422b83 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:40.703530 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84cfafce-d006-492d-9bcc-4e4f28422b83 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:40.704310 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84cfafce-d006-492d-9bcc-4e4f28422b83 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:40.704741 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84cfafce-d006-492d-9bcc-4e4f28422b83 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:40.768651 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-84cfafce-d006-492d-9bcc-4e4f28422b83 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:40.776263 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-84cfafce-d006-492d-9bcc-4e4f28422b83 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1295 microversion: 2.1 time: 0.083663 Nov 08 16:11:40.776820 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 48/92] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:40 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1295 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:40.947175 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-94bb88a6-39fc-4e0a-80be-75bb7d13dfe9 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:40.947887 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-94bb88a6-39fc-4e0a-80be-75bb7d13dfe9 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:40.953835 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-94bb88a6-39fc-4e0a-80be-75bb7d13dfe9 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:40.954283 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-94bb88a6-39fc-4e0a-80be-75bb7d13dfe9 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:40.955044 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-94bb88a6-39fc-4e0a-80be-75bb7d13dfe9 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:40.955478 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-94bb88a6-39fc-4e0a-80be-75bb7d13dfe9 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:41.080959 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-94bb88a6-39fc-4e0a-80be-75bb7d13dfe9 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:41.088751 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-94bb88a6-39fc-4e0a-80be-75bb7d13dfe9 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.145736 Nov 08 16:11:41.089330 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 45/93] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:40 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:41.353066 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e7c6354a-c6fd-46a9-b435-72ab1cd452c6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:41.354189 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e7c6354a-c6fd-46a9-b435-72ab1cd452c6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:41.362587 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e7c6354a-c6fd-46a9-b435-72ab1cd452c6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:41.363374 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e7c6354a-c6fd-46a9-b435-72ab1cd452c6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:41.364489 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e7c6354a-c6fd-46a9-b435-72ab1cd452c6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:41.365152 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e7c6354a-c6fd-46a9-b435-72ab1cd452c6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:41.446328 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1b99acc6-512d-45ae-8092-06611de3b868 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:41.447177 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1b99acc6-512d-45ae-8092-06611de3b868 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:41.453411 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1b99acc6-512d-45ae-8092-06611de3b868 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:41.454138 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1b99acc6-512d-45ae-8092-06611de3b868 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:41.455068 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1b99acc6-512d-45ae-8092-06611de3b868 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:41.455676 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1b99acc6-512d-45ae-8092-06611de3b868 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:41.897731 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-e7c6354a-c6fd-46a9-b435-72ab1cd452c6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:41.911754 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e7c6354a-c6fd-46a9-b435-72ab1cd452c6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.562459 Nov 08 16:11:41.913125 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 49/94] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:41 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:41.926147 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-97238200-efc4-4331-be75-ad46a5c453a6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:41.926896 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-97238200-efc4-4331-be75-ad46a5c453a6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:41.934157 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-97238200-efc4-4331-be75-ad46a5c453a6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:41.934716 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-97238200-efc4-4331-be75-ad46a5c453a6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:41.935695 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-97238200-efc4-4331-be75-ad46a5c453a6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:41.935803 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1b99acc6-512d-45ae-8092-06611de3b868 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:41.936103 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-97238200-efc4-4331-be75-ad46a5c453a6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:41.944355 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1b99acc6-512d-45ae-8092-06611de3b868 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:41.946091 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1b99acc6-512d-45ae-8092-06611de3b868 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:41.947373 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1b99acc6-512d-45ae-8092-06611de3b868 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.504911 Nov 08 16:11:41.948691 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 46/95] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:41 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:11:41.956350 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e0d4e8e6-63e9-4180-925e-70444df2d357 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:41.957205 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e0d4e8e6-63e9-4180-925e-70444df2d357 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:41.969807 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e0d4e8e6-63e9-4180-925e-70444df2d357 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:41.970818 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e0d4e8e6-63e9-4180-925e-70444df2d357 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:41.972179 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e0d4e8e6-63e9-4180-925e-70444df2d357 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:41.972729 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e0d4e8e6-63e9-4180-925e-70444df2d357 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:42.134960 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e0d4e8e6-63e9-4180-925e-70444df2d357 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:42.142886 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e0d4e8e6-63e9-4180-925e-70444df2d357 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1295 microversion: 2.1 time: 0.190947 Nov 08 16:11:42.143569 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 47/96] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:41 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1295 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:42.148454 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-eba49773-aad6-4d9a-b224-b01aaeacc0a6 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:42.149366 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-eba49773-aad6-4d9a-b224-b01aaeacc0a6 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:42.156580 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-eba49773-aad6-4d9a-b224-b01aaeacc0a6 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:42.157344 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-eba49773-aad6-4d9a-b224-b01aaeacc0a6 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:42.158273 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-eba49773-aad6-4d9a-b224-b01aaeacc0a6 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:42.158768 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-eba49773-aad6-4d9a-b224-b01aaeacc0a6 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:42.440844 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-97238200-efc4-4331-be75-ad46a5c453a6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:42.468312 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-97238200-efc4-4331-be75-ad46a5c453a6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.553406 Nov 08 16:11:42.481331 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 50/97] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:41 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:42.522294 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-eba49773-aad6-4d9a-b224-b01aaeacc0a6 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:42.529539 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-eba49773-aad6-4d9a-b224-b01aaeacc0a6 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.384755 Nov 08 16:11:42.542304 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 48/98] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:42 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:42.572430 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-1fafdcbb-305e-4cfa-af27-f04237dd8448 req-4c29c979-bf54-44e1-87a1-62d2d8fc8da3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3a953f3-d586-4495-b2d1-3c6e6cd89a52", "tag": "3e7ad14a-6975-4075-ac69-3a504ad24341"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:11:42.574161 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:11:42.574161 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:11:42.582009 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-1fafdcbb-305e-4cfa-af27-f04237dd8448 req-4c29c979-bf54-44e1-87a1-62d2d8fc8da3 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:42.582703 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-1fafdcbb-305e-4cfa-af27-f04237dd8448 req-4c29c979-bf54-44e1-87a1-62d2d8fc8da3 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:42.595507 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-1fafdcbb-305e-4cfa-af27-f04237dd8448 req-4c29c979-bf54-44e1-87a1-62d2d8fc8da3 service nova] Creating event network-changed:3e7ad14a-6975-4075-ac69-3a504ad24341 for instance a3a953f3-d586-4495-b2d1-3c6e6cd89a52 on hv-cinder-81618 Nov 08 16:11:42.601888 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-1fafdcbb-305e-4cfa-af27-f04237dd8448 req-4c29c979-bf54-44e1-87a1-62d2d8fc8da3 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034363 Nov 08 16:11:42.603065 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 51/99] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:11:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:11:42.929861 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-750153de-1dd9-4a04-aaa6-c8574c1f8f6b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:42.930525 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-750153de-1dd9-4a04-aaa6-c8574c1f8f6b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:42.937858 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-750153de-1dd9-4a04-aaa6-c8574c1f8f6b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:42.938643 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-750153de-1dd9-4a04-aaa6-c8574c1f8f6b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:42.939617 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-750153de-1dd9-4a04-aaa6-c8574c1f8f6b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:42.940208 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-750153de-1dd9-4a04-aaa6-c8574c1f8f6b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:42.967845 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-7fa89b6f-4c28-47e3-aea3-4e7df0126a4f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:42.968964 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-7fa89b6f-4c28-47e3-aea3-4e7df0126a4f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:42.985231 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7fa89b6f-4c28-47e3-aea3-4e7df0126a4f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:42.985690 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7fa89b6f-4c28-47e3-aea3-4e7df0126a4f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:42.989343 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7fa89b6f-4c28-47e3-aea3-4e7df0126a4f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:42.989817 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7fa89b6f-4c28-47e3-aea3-4e7df0126a4f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:43.469182 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7fa89b6f-4c28-47e3-aea3-4e7df0126a4f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:43.483696 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7fa89b6f-4c28-47e3-aea3-4e7df0126a4f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:43.484895 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-750153de-1dd9-4a04-aaa6-c8574c1f8f6b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:43.491160 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7fa89b6f-4c28-47e3-aea3-4e7df0126a4f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:43.492867 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-750153de-1dd9-4a04-aaa6-c8574c1f8f6b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.567456 Nov 08 16:11:43.493131 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-7fa89b6f-4c28-47e3-aea3-4e7df0126a4f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.529986 Nov 08 16:11:43.493650 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 49/100] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:42 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:43.494575 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 52/101] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:42 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:11:43.498191 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c31cf270-103e-40db-ad13-ff6e7fe56a23 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:43.499048 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c31cf270-103e-40db-ad13-ff6e7fe56a23 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:43.508319 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-17d12099-45d8-44fc-a0ae-8e8a6a586dca tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:43.510369 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-17d12099-45d8-44fc-a0ae-8e8a6a586dca tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:43.518249 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-17d12099-45d8-44fc-a0ae-8e8a6a586dca tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:43.518929 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-17d12099-45d8-44fc-a0ae-8e8a6a586dca tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:43.519817 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c31cf270-103e-40db-ad13-ff6e7fe56a23 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:43.520440 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c31cf270-103e-40db-ad13-ff6e7fe56a23 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:43.520607 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-17d12099-45d8-44fc-a0ae-8e8a6a586dca tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:43.521050 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-17d12099-45d8-44fc-a0ae-8e8a6a586dca tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:43.521704 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c31cf270-103e-40db-ad13-ff6e7fe56a23 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:43.522325 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c31cf270-103e-40db-ad13-ff6e7fe56a23 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:43.964267 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-17d12099-45d8-44fc-a0ae-8e8a6a586dca tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:43.973268 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-17d12099-45d8-44fc-a0ae-8e8a6a586dca tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.477405 Nov 08 16:11:43.974015 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 53/102] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:43 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:43.980124 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-25337a90-1230-4b43-8b73-9935a5d9f94b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:43.981040 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-25337a90-1230-4b43-8b73-9935a5d9f94b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:43.987389 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25337a90-1230-4b43-8b73-9935a5d9f94b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:43.988561 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c31cf270-103e-40db-ad13-ff6e7fe56a23 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:43.988695 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25337a90-1230-4b43-8b73-9935a5d9f94b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:43.989451 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25337a90-1230-4b43-8b73-9935a5d9f94b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:43.989919 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25337a90-1230-4b43-8b73-9935a5d9f94b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:43.999256 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c31cf270-103e-40db-ad13-ff6e7fe56a23 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.504210 Nov 08 16:11:44.000267 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 50/103] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:43 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:44.274779 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-25337a90-1230-4b43-8b73-9935a5d9f94b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:44.282808 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-25337a90-1230-4b43-8b73-9935a5d9f94b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.306807 Nov 08 16:11:44.293334 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 54/104] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:43 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:44.515927 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-00bb79c1-36c8-4e6b-9952-ade12d0b25b0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:44.518467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-00bb79c1-36c8-4e6b-9952-ade12d0b25b0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:44.521098 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6a8a50ce-beaa-4137-9b38-2d6ce68d3fe3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:44.522860 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6a8a50ce-beaa-4137-9b38-2d6ce68d3fe3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:44.528854 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-00bb79c1-36c8-4e6b-9952-ade12d0b25b0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:44.529658 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-00bb79c1-36c8-4e6b-9952-ade12d0b25b0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:44.530845 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-00bb79c1-36c8-4e6b-9952-ade12d0b25b0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:44.531427 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-00bb79c1-36c8-4e6b-9952-ade12d0b25b0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:44.538659 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6a8a50ce-beaa-4137-9b38-2d6ce68d3fe3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:44.539332 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6a8a50ce-beaa-4137-9b38-2d6ce68d3fe3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:44.540161 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6a8a50ce-beaa-4137-9b38-2d6ce68d3fe3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:44.540589 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6a8a50ce-beaa-4137-9b38-2d6ce68d3fe3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:44.899223 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-00bb79c1-36c8-4e6b-9952-ade12d0b25b0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:44.901390 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6a8a50ce-beaa-4137-9b38-2d6ce68d3fe3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:44.906964 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-00bb79c1-36c8-4e6b-9952-ade12d0b25b0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.401328 Nov 08 16:11:44.907656 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 51/105] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:44 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:44.909460 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6a8a50ce-beaa-4137-9b38-2d6ce68d3fe3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:44.910989 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6a8a50ce-beaa-4137-9b38-2d6ce68d3fe3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:44.912084 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6a8a50ce-beaa-4137-9b38-2d6ce68d3fe3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.395161 Nov 08 16:11:44.913636 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 55/106] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:44 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:11:44.913785 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-cf533a4e-2930-49b0-97fe-ed0f8093cacf req-b3dd0164-1ec2-4972-9afb-ae9568e8d64d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b76ed94d-63f4-4597-be02-f3fc032b85aa", "tag": "f4784d76-6af7-4b31-a9f3-ee25c9087b51"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:11:44.918761 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:11:44.918761 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:11:44.922589 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-cf533a4e-2930-49b0-97fe-ed0f8093cacf req-b3dd0164-1ec2-4972-9afb-ae9568e8d64d service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:44.923099 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-cf533a4e-2930-49b0-97fe-ed0f8093cacf req-b3dd0164-1ec2-4972-9afb-ae9568e8d64d service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:44.934342 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-cf533a4e-2930-49b0-97fe-ed0f8093cacf req-b3dd0164-1ec2-4972-9afb-ae9568e8d64d service nova] Creating event network-changed:f4784d76-6af7-4b31-a9f3-ee25c9087b51 for instance b76ed94d-63f4-4597-be02-f3fc032b85aa on hv-cinder-81618 Nov 08 16:11:44.939583 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-cf533a4e-2930-49b0-97fe-ed0f8093cacf req-b3dd0164-1ec2-4972-9afb-ae9568e8d64d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030378 Nov 08 16:11:44.940177 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 52/107] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:11:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:11:44.991096 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4aaa6425-f040-4ebe-813a-42d922f7c824 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:44.991640 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4aaa6425-f040-4ebe-813a-42d922f7c824 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:44.997398 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4aaa6425-f040-4ebe-813a-42d922f7c824 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:44.997875 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4aaa6425-f040-4ebe-813a-42d922f7c824 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:44.998903 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4aaa6425-f040-4ebe-813a-42d922f7c824 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:44.999331 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4aaa6425-f040-4ebe-813a-42d922f7c824 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:45.017114 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4596a76c-9ec8-424c-823a-cf33883454cd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:45.017826 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4596a76c-9ec8-424c-823a-cf33883454cd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:45.024864 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4596a76c-9ec8-424c-823a-cf33883454cd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:45.025304 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4596a76c-9ec8-424c-823a-cf33883454cd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:45.026313 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4596a76c-9ec8-424c-823a-cf33883454cd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:45.026830 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4596a76c-9ec8-424c-823a-cf33883454cd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:45.198958 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4aaa6425-f040-4ebe-813a-42d922f7c824 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:45.208291 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4aaa6425-f040-4ebe-813a-42d922f7c824 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.221380 Nov 08 16:11:45.218355 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 56/108] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:44 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:45.246492 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4596a76c-9ec8-424c-823a-cf33883454cd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:45.254001 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4596a76c-9ec8-424c-823a-cf33883454cd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.241276 Nov 08 16:11:45.254567 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 53/109] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:45 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:45.299213 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8d45277d-ef0d-4b02-8919-b45c29ea9798 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:45.299842 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8d45277d-ef0d-4b02-8919-b45c29ea9798 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:45.306009 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8d45277d-ef0d-4b02-8919-b45c29ea9798 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:45.306450 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8d45277d-ef0d-4b02-8919-b45c29ea9798 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:45.307199 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8d45277d-ef0d-4b02-8919-b45c29ea9798 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:45.307618 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8d45277d-ef0d-4b02-8919-b45c29ea9798 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:45.436718 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8d45277d-ef0d-4b02-8919-b45c29ea9798 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:45.444548 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8d45277d-ef0d-4b02-8919-b45c29ea9798 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.148903 Nov 08 16:11:45.445186 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 57/110] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:45 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:45.924209 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-225b4516-94e5-4e14-99d5-67098a35cd08 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:45.924934 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-225b4516-94e5-4e14-99d5-67098a35cd08 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:45.931815 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ca30b9fc-8b0f-4a51-9a26-e896e5e83c8a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:45.932408 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ca30b9fc-8b0f-4a51-9a26-e896e5e83c8a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:45.932535 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-225b4516-94e5-4e14-99d5-67098a35cd08 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:45.933205 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-225b4516-94e5-4e14-99d5-67098a35cd08 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:45.934233 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-225b4516-94e5-4e14-99d5-67098a35cd08 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:45.934524 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-225b4516-94e5-4e14-99d5-67098a35cd08 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:45.939117 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ca30b9fc-8b0f-4a51-9a26-e896e5e83c8a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:45.942761 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ca30b9fc-8b0f-4a51-9a26-e896e5e83c8a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:45.943589 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ca30b9fc-8b0f-4a51-9a26-e896e5e83c8a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:45.944744 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ca30b9fc-8b0f-4a51-9a26-e896e5e83c8a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:46.142863 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ca30b9fc-8b0f-4a51-9a26-e896e5e83c8a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:46.147785 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-225b4516-94e5-4e14-99d5-67098a35cd08 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:46.151978 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ca30b9fc-8b0f-4a51-9a26-e896e5e83c8a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:46.154034 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ca30b9fc-8b0f-4a51-9a26-e896e5e83c8a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:46.161920 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-225b4516-94e5-4e14-99d5-67098a35cd08 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.241221 Nov 08 16:11:46.163659 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 54/111] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:45 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:46.163881 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ca30b9fc-8b0f-4a51-9a26-e896e5e83c8a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.235122 Nov 08 16:11:46.174704 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 58/112] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:45 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:11:46.225365 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-dba27b7f-c0b2-432e-89c0-0d00d3dfcc0c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:46.226085 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-dba27b7f-c0b2-432e-89c0-0d00d3dfcc0c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:46.231900 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dba27b7f-c0b2-432e-89c0-0d00d3dfcc0c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:46.232350 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dba27b7f-c0b2-432e-89c0-0d00d3dfcc0c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:46.233118 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dba27b7f-c0b2-432e-89c0-0d00d3dfcc0c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:46.233566 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dba27b7f-c0b2-432e-89c0-0d00d3dfcc0c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:46.274912 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d5dc9f3c-9600-4656-b2d0-3efe3df8ed7c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:46.275514 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d5dc9f3c-9600-4656-b2d0-3efe3df8ed7c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:46.281305 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5dc9f3c-9600-4656-b2d0-3efe3df8ed7c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:46.281766 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5dc9f3c-9600-4656-b2d0-3efe3df8ed7c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:46.282531 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5dc9f3c-9600-4656-b2d0-3efe3df8ed7c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:46.282971 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5dc9f3c-9600-4656-b2d0-3efe3df8ed7c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:46.399278 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-dba27b7f-c0b2-432e-89c0-0d00d3dfcc0c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:46.406842 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-dba27b7f-c0b2-432e-89c0-0d00d3dfcc0c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.185076 Nov 08 16:11:46.407417 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 55/113] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:46 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:46.442773 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d5dc9f3c-9600-4656-b2d0-3efe3df8ed7c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:46.449886 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d5dc9f3c-9600-4656-b2d0-3efe3df8ed7c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.182506 Nov 08 16:11:46.450444 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 59/114] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:46 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:46.459908 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7533c996-ca8e-4542-bbc5-11ea962b4670 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:46.460598 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7533c996-ca8e-4542-bbc5-11ea962b4670 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:46.466405 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7533c996-ca8e-4542-bbc5-11ea962b4670 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:46.466921 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7533c996-ca8e-4542-bbc5-11ea962b4670 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:46.467783 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7533c996-ca8e-4542-bbc5-11ea962b4670 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:46.468284 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7533c996-ca8e-4542-bbc5-11ea962b4670 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:46.596173 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7533c996-ca8e-4542-bbc5-11ea962b4670 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:46.604065 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7533c996-ca8e-4542-bbc5-11ea962b4670 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.147733 Nov 08 16:11:46.604631 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 56/115] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:46 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:47.180136 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-74bcc7a7-d10a-4cbe-b87e-bcc34c93357f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:47.180762 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-74bcc7a7-d10a-4cbe-b87e-bcc34c93357f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:47.181756 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3be997b6-70d2-4337-af2a-9cfad3b7aa7d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:47.182370 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3be997b6-70d2-4337-af2a-9cfad3b7aa7d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:47.186736 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-74bcc7a7-d10a-4cbe-b87e-bcc34c93357f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:47.187179 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-74bcc7a7-d10a-4cbe-b87e-bcc34c93357f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:47.187944 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-74bcc7a7-d10a-4cbe-b87e-bcc34c93357f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:47.188090 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3be997b6-70d2-4337-af2a-9cfad3b7aa7d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:47.188370 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-74bcc7a7-d10a-4cbe-b87e-bcc34c93357f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:47.188542 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3be997b6-70d2-4337-af2a-9cfad3b7aa7d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:47.189308 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3be997b6-70d2-4337-af2a-9cfad3b7aa7d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:47.189762 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3be997b6-70d2-4337-af2a-9cfad3b7aa7d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:47.401436 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-74bcc7a7-d10a-4cbe-b87e-bcc34c93357f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:47.405177 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-3be997b6-70d2-4337-af2a-9cfad3b7aa7d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:47.409374 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-74bcc7a7-d10a-4cbe-b87e-bcc34c93357f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.232949 Nov 08 16:11:47.410768 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 60/116] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:47 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:47.414191 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-3be997b6-70d2-4337-af2a-9cfad3b7aa7d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:47.415776 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-3be997b6-70d2-4337-af2a-9cfad3b7aa7d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:47.416811 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3be997b6-70d2-4337-af2a-9cfad3b7aa7d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.238694 Nov 08 16:11:47.417355 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 57/117] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:47 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:11:47.423545 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-061cabd5-b55a-4e4a-8ca6-b11d18073d8f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:47.424137 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-061cabd5-b55a-4e4a-8ca6-b11d18073d8f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:47.430194 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-061cabd5-b55a-4e4a-8ca6-b11d18073d8f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:47.430660 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-061cabd5-b55a-4e4a-8ca6-b11d18073d8f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:47.431449 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-061cabd5-b55a-4e4a-8ca6-b11d18073d8f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:47.431873 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-061cabd5-b55a-4e4a-8ca6-b11d18073d8f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:47.466940 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9395e87a-597e-4126-940a-6a985af23f47 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:47.467672 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9395e87a-597e-4126-940a-6a985af23f47 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:47.473535 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9395e87a-597e-4126-940a-6a985af23f47 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:47.474021 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9395e87a-597e-4126-940a-6a985af23f47 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:47.474837 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9395e87a-597e-4126-940a-6a985af23f47 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:47.475270 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9395e87a-597e-4126-940a-6a985af23f47 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:47.590932 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-061cabd5-b55a-4e4a-8ca6-b11d18073d8f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:47.598248 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-061cabd5-b55a-4e4a-8ca6-b11d18073d8f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.178181 Nov 08 16:11:47.607453 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 61/118] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:47 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:47.620404 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1ebe809a-0299-4c69-887c-84befd440d63 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:47.620990 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1ebe809a-0299-4c69-887c-84befd440d63 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:47.626844 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1ebe809a-0299-4c69-887c-84befd440d63 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:47.627295 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1ebe809a-0299-4c69-887c-84befd440d63 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:47.628028 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1ebe809a-0299-4c69-887c-84befd440d63 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:47.628448 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1ebe809a-0299-4c69-887c-84befd440d63 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:47.634362 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-9395e87a-597e-4126-940a-6a985af23f47 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:47.641641 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9395e87a-597e-4126-940a-6a985af23f47 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.178261 Nov 08 16:11:47.642257 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 58/119] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:47 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:47.757076 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1ebe809a-0299-4c69-887c-84befd440d63 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:47.764373 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1ebe809a-0299-4c69-887c-84befd440d63 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.147458 Nov 08 16:11:47.764942 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 62/120] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:47 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:48.426502 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-86182f17-1b67-452c-a8ee-9698d48e7694 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:48.427046 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-86182f17-1b67-452c-a8ee-9698d48e7694 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:48.433556 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-86182f17-1b67-452c-a8ee-9698d48e7694 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:48.434025 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-86182f17-1b67-452c-a8ee-9698d48e7694 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:48.434666 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3869f923-6d69-4764-b680-aaf1b80676b7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:48.435067 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-86182f17-1b67-452c-a8ee-9698d48e7694 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:48.435197 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-86182f17-1b67-452c-a8ee-9698d48e7694 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:48.435290 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3869f923-6d69-4764-b680-aaf1b80676b7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:48.440894 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3869f923-6d69-4764-b680-aaf1b80676b7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:48.441327 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3869f923-6d69-4764-b680-aaf1b80676b7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:48.442114 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3869f923-6d69-4764-b680-aaf1b80676b7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:48.442650 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3869f923-6d69-4764-b680-aaf1b80676b7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:48.617254 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-86182f17-1b67-452c-a8ee-9698d48e7694 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:48.621227 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3869f923-6d69-4764-b680-aaf1b80676b7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:48.624922 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-86182f17-1b67-452c-a8ee-9698d48e7694 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.202127 Nov 08 16:11:48.625561 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 59/121] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:48 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:48.629076 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3869f923-6d69-4764-b680-aaf1b80676b7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:48.630222 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-62fe4b89-e191-46f6-a02e-71c4c6526449 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:48.630592 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3869f923-6d69-4764-b680-aaf1b80676b7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:48.630989 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-62fe4b89-e191-46f6-a02e-71c4c6526449 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:48.631727 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3869f923-6d69-4764-b680-aaf1b80676b7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.200800 Nov 08 16:11:48.632388 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 63/122] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:48 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:11:48.636919 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-62fe4b89-e191-46f6-a02e-71c4c6526449 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:48.637356 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-62fe4b89-e191-46f6-a02e-71c4c6526449 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:48.638144 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-62fe4b89-e191-46f6-a02e-71c4c6526449 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:48.638574 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-62fe4b89-e191-46f6-a02e-71c4c6526449 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:48.657480 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f59f4f0e-6635-466d-acf8-8b30dbc5b28a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:48.658098 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f59f4f0e-6635-466d-acf8-8b30dbc5b28a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:48.664249 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f59f4f0e-6635-466d-acf8-8b30dbc5b28a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:48.664685 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f59f4f0e-6635-466d-acf8-8b30dbc5b28a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:48.665430 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f59f4f0e-6635-466d-acf8-8b30dbc5b28a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:48.665877 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f59f4f0e-6635-466d-acf8-8b30dbc5b28a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:48.833162 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-62fe4b89-e191-46f6-a02e-71c4c6526449 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:48.835460 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f59f4f0e-6635-466d-acf8-8b30dbc5b28a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:48.841062 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-62fe4b89-e191-46f6-a02e-71c4c6526449 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.214474 Nov 08 16:11:48.841630 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 60/123] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:48 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:48.842417 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f59f4f0e-6635-466d-acf8-8b30dbc5b28a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.188377 Nov 08 16:11:48.843134 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 64/124] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:48 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:48.849169 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-813c6b6a-796a-4857-b8e8-658416264f51 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:48.850434 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-813c6b6a-796a-4857-b8e8-658416264f51 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:48.856036 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-813c6b6a-796a-4857-b8e8-658416264f51 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:48.856475 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-813c6b6a-796a-4857-b8e8-658416264f51 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:48.857251 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-813c6b6a-796a-4857-b8e8-658416264f51 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:48.857668 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-813c6b6a-796a-4857-b8e8-658416264f51 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:49.163383 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-813c6b6a-796a-4857-b8e8-658416264f51 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:49.170665 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-813c6b6a-796a-4857-b8e8-658416264f51 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.328067 Nov 08 16:11:49.171215 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 61/125] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:48 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:49.641489 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0554df11-6570-4fd8-9be8-e07106dc8eeb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:49.642155 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0554df11-6570-4fd8-9be8-e07106dc8eeb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:49.648694 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0554df11-6570-4fd8-9be8-e07106dc8eeb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:49.648856 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-22bf5d16-5d5d-4a2e-b3a9-71d59d11f42e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:49.649273 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0554df11-6570-4fd8-9be8-e07106dc8eeb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:49.649367 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-22bf5d16-5d5d-4a2e-b3a9-71d59d11f42e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:49.649902 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0554df11-6570-4fd8-9be8-e07106dc8eeb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:49.650325 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0554df11-6570-4fd8-9be8-e07106dc8eeb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:49.655176 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-22bf5d16-5d5d-4a2e-b3a9-71d59d11f42e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:49.655563 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-22bf5d16-5d5d-4a2e-b3a9-71d59d11f42e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:49.656330 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-22bf5d16-5d5d-4a2e-b3a9-71d59d11f42e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:49.656754 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-22bf5d16-5d5d-4a2e-b3a9-71d59d11f42e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:49.887273 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0554df11-6570-4fd8-9be8-e07106dc8eeb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:49.894525 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0554df11-6570-4fd8-9be8-e07106dc8eeb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.256686 Nov 08 16:11:49.895095 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 65/126] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:49 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:49.899464 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-22bf5d16-5d5d-4a2e-b3a9-71d59d11f42e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:49.899896 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-50fb9788-7b65-4ba5-b71d-f72e7b838a94 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:49.900482 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-50fb9788-7b65-4ba5-b71d-f72e7b838a94 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:49.906430 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-50fb9788-7b65-4ba5-b71d-f72e7b838a94 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:49.906815 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-50fb9788-7b65-4ba5-b71d-f72e7b838a94 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:49.907577 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-50fb9788-7b65-4ba5-b71d-f72e7b838a94 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:49.907876 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-22bf5d16-5d5d-4a2e-b3a9-71d59d11f42e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:49.908005 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-50fb9788-7b65-4ba5-b71d-f72e7b838a94 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:49.909751 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-22bf5d16-5d5d-4a2e-b3a9-71d59d11f42e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:49.910704 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-22bf5d16-5d5d-4a2e-b3a9-71d59d11f42e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.265887 Nov 08 16:11:49.911252 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 62/127] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:49 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:11:49.916217 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bc592bf4-be7e-4301-b699-5883dbc21736 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:49.916856 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-bc592bf4-be7e-4301-b699-5883dbc21736 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:49.922872 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bc592bf4-be7e-4301-b699-5883dbc21736 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:49.923320 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bc592bf4-be7e-4301-b699-5883dbc21736 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:49.924088 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bc592bf4-be7e-4301-b699-5883dbc21736 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:49.924515 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bc592bf4-be7e-4301-b699-5883dbc21736 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:50.106261 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-bc592bf4-be7e-4301-b699-5883dbc21736 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:50.110023 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-50fb9788-7b65-4ba5-b71d-f72e7b838a94 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:50.113650 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bc592bf4-be7e-4301-b699-5883dbc21736 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.201243 Nov 08 16:11:50.114250 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 63/128] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:49 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:50.117702 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-50fb9788-7b65-4ba5-b71d-f72e7b838a94 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.221632 Nov 08 16:11:50.118377 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 66/129] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:49 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:50.187517 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2fa6da1c-203b-4c2e-8ae2-60717eb0eeb1 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:50.188114 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2fa6da1c-203b-4c2e-8ae2-60717eb0eeb1 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:50.194761 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2fa6da1c-203b-4c2e-8ae2-60717eb0eeb1 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:50.195203 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2fa6da1c-203b-4c2e-8ae2-60717eb0eeb1 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:50.195963 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2fa6da1c-203b-4c2e-8ae2-60717eb0eeb1 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:50.196392 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2fa6da1c-203b-4c2e-8ae2-60717eb0eeb1 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:50.325573 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-2fa6da1c-203b-4c2e-8ae2-60717eb0eeb1 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:50.332830 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2fa6da1c-203b-4c2e-8ae2-60717eb0eeb1 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.149002 Nov 08 16:11:50.333385 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 64/130] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:50 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:50.911307 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-cc187f08-4f88-4732-9cd0-2bab26b4759b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:50.911897 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-cc187f08-4f88-4732-9cd0-2bab26b4759b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:50.918481 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cc187f08-4f88-4732-9cd0-2bab26b4759b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:50.918921 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cc187f08-4f88-4732-9cd0-2bab26b4759b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:50.919672 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cc187f08-4f88-4732-9cd0-2bab26b4759b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:50.920091 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cc187f08-4f88-4732-9cd0-2bab26b4759b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:50.928579 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d2a3762f-65fb-4d45-9225-5ef9f49a7e74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:50.929178 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d2a3762f-65fb-4d45-9225-5ef9f49a7e74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:50.934950 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d2a3762f-65fb-4d45-9225-5ef9f49a7e74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:50.935394 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d2a3762f-65fb-4d45-9225-5ef9f49a7e74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:50.936161 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d2a3762f-65fb-4d45-9225-5ef9f49a7e74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:50.936594 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d2a3762f-65fb-4d45-9225-5ef9f49a7e74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:51.113289 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-cc187f08-4f88-4732-9cd0-2bab26b4759b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:51.117474 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-d2a3762f-65fb-4d45-9225-5ef9f49a7e74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:51.120728 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-cc187f08-4f88-4732-9cd0-2bab26b4759b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.213003 Nov 08 16:11:51.121372 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 67/131] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:50 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:51.125616 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-d2a3762f-65fb-4d45-9225-5ef9f49a7e74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:51.127142 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-d2a3762f-65fb-4d45-9225-5ef9f49a7e74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:51.128229 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d2a3762f-65fb-4d45-9225-5ef9f49a7e74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.203947 Nov 08 16:11:51.128941 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 65/132] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:50 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:11:51.131522 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-7837fe4f-f865-4d8f-ae72-45b642c6d077 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:51.132187 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-7837fe4f-f865-4d8f-ae72-45b642c6d077 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:51.134227 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-05297358-3304-46c1-86c4-e7107127226f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:51.134890 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-05297358-3304-46c1-86c4-e7107127226f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:51.138164 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7837fe4f-f865-4d8f-ae72-45b642c6d077 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:51.138603 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7837fe4f-f865-4d8f-ae72-45b642c6d077 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:51.139359 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7837fe4f-f865-4d8f-ae72-45b642c6d077 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:51.139775 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7837fe4f-f865-4d8f-ae72-45b642c6d077 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:51.140576 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-05297358-3304-46c1-86c4-e7107127226f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:51.141017 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-05297358-3304-46c1-86c4-e7107127226f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:51.141794 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-05297358-3304-46c1-86c4-e7107127226f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:51.142224 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-05297358-3304-46c1-86c4-e7107127226f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:51.326383 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7837fe4f-f865-4d8f-ae72-45b642c6d077 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:51.330405 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-05297358-3304-46c1-86c4-e7107127226f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:51.336063 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-7837fe4f-f865-4d8f-ae72-45b642c6d077 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.209543 Nov 08 16:11:51.336983 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 68/133] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:51 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:51.338618 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-05297358-3304-46c1-86c4-e7107127226f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.207762 Nov 08 16:11:51.339279 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 66/134] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:51 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:51.349481 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e03107f1-81e7-4970-9b4f-0eeee4c066ba tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:51.350685 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e03107f1-81e7-4970-9b4f-0eeee4c066ba tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:51.356454 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e03107f1-81e7-4970-9b4f-0eeee4c066ba tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:51.356927 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e03107f1-81e7-4970-9b4f-0eeee4c066ba tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:51.362856 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e03107f1-81e7-4970-9b4f-0eeee4c066ba tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:51.363865 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e03107f1-81e7-4970-9b4f-0eeee4c066ba tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:51.490947 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-e03107f1-81e7-4970-9b4f-0eeee4c066ba tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:51.498425 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e03107f1-81e7-4970-9b4f-0eeee4c066ba tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.152701 Nov 08 16:11:51.499239 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 69/135] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:51 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:52.137764 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bfae1d42-2bcb-4513-b5e8-8842054b2e15 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:52.138362 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-bfae1d42-2bcb-4513-b5e8-8842054b2e15 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:52.144266 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bfae1d42-2bcb-4513-b5e8-8842054b2e15 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:52.144702 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bfae1d42-2bcb-4513-b5e8-8842054b2e15 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:52.145461 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bfae1d42-2bcb-4513-b5e8-8842054b2e15 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:52.145805 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-7aeb72c8-d10b-4106-a747-30a681591470 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:52.146190 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bfae1d42-2bcb-4513-b5e8-8842054b2e15 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:52.146410 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-7aeb72c8-d10b-4106-a747-30a681591470 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:52.152239 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7aeb72c8-d10b-4106-a747-30a681591470 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:52.152676 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7aeb72c8-d10b-4106-a747-30a681591470 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:52.153435 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7aeb72c8-d10b-4106-a747-30a681591470 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:52.153892 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7aeb72c8-d10b-4106-a747-30a681591470 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:52.333663 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-bfae1d42-2bcb-4513-b5e8-8842054b2e15 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:52.337408 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7aeb72c8-d10b-4106-a747-30a681591470 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:52.341691 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bfae1d42-2bcb-4513-b5e8-8842054b2e15 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.207512 Nov 08 16:11:52.342292 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 67/136] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:52 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:52.345136 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7aeb72c8-d10b-4106-a747-30a681591470 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:52.346753 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7aeb72c8-d10b-4106-a747-30a681591470 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:52.347948 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-7aeb72c8-d10b-4106-a747-30a681591470 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.205867 Nov 08 16:11:52.348632 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 70/137] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:52 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:11:52.352218 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0729f4b0-a7d6-4dd1-8bc3-01052cafc3e1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:52.352805 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0729f4b0-a7d6-4dd1-8bc3-01052cafc3e1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:52.358705 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0729f4b0-a7d6-4dd1-8bc3-01052cafc3e1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:52.359143 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0729f4b0-a7d6-4dd1-8bc3-01052cafc3e1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:52.359543 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1a4a6cd6-0048-407d-9dfd-9d58b086cc1e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:52.360030 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0729f4b0-a7d6-4dd1-8bc3-01052cafc3e1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:52.360287 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1a4a6cd6-0048-407d-9dfd-9d58b086cc1e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:52.360458 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0729f4b0-a7d6-4dd1-8bc3-01052cafc3e1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:52.368738 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1a4a6cd6-0048-407d-9dfd-9d58b086cc1e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:52.368738 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1a4a6cd6-0048-407d-9dfd-9d58b086cc1e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:52.368738 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1a4a6cd6-0048-407d-9dfd-9d58b086cc1e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:52.368738 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1a4a6cd6-0048-407d-9dfd-9d58b086cc1e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:52.551323 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0729f4b0-a7d6-4dd1-8bc3-01052cafc3e1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:52.558817 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1a4a6cd6-0048-407d-9dfd-9d58b086cc1e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:52.559445 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0729f4b0-a7d6-4dd1-8bc3-01052cafc3e1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.211093 Nov 08 16:11:52.560009 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 68/138] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:52 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:52.564729 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f8ecfc28-bb86-4583-8eb3-e13431de93e2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:52.564981 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f8ecfc28-bb86-4583-8eb3-e13431de93e2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:52.569456 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1a4a6cd6-0048-407d-9dfd-9d58b086cc1e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.213465 Nov 08 16:11:52.570065 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 71/139] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:52 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:52.571251 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8ecfc28-bb86-4583-8eb3-e13431de93e2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:52.571687 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8ecfc28-bb86-4583-8eb3-e13431de93e2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:52.572460 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8ecfc28-bb86-4583-8eb3-e13431de93e2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:52.572880 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8ecfc28-bb86-4583-8eb3-e13431de93e2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:52.696624 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f8ecfc28-bb86-4583-8eb3-e13431de93e2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:52.703649 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f8ecfc28-bb86-4583-8eb3-e13431de93e2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.142581 Nov 08 16:11:52.704207 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 69/140] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:52 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:53.359386 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5872069b-3ae8-4754-8bf6-dd95fdfc07b6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:53.359947 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5872069b-3ae8-4754-8bf6-dd95fdfc07b6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:53.365687 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b3cab0c9-ac65-4b88-a654-cd9bec9cb043 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:53.366258 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5872069b-3ae8-4754-8bf6-dd95fdfc07b6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:53.366367 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b3cab0c9-ac65-4b88-a654-cd9bec9cb043 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:53.366694 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5872069b-3ae8-4754-8bf6-dd95fdfc07b6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:53.367467 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5872069b-3ae8-4754-8bf6-dd95fdfc07b6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:53.367897 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5872069b-3ae8-4754-8bf6-dd95fdfc07b6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:53.372089 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b3cab0c9-ac65-4b88-a654-cd9bec9cb043 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:53.372533 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b3cab0c9-ac65-4b88-a654-cd9bec9cb043 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:53.373901 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b3cab0c9-ac65-4b88-a654-cd9bec9cb043 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:53.374338 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b3cab0c9-ac65-4b88-a654-cd9bec9cb043 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:53.562761 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b3cab0c9-ac65-4b88-a654-cd9bec9cb043 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:53.566169 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-5872069b-3ae8-4754-8bf6-dd95fdfc07b6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:53.571384 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b3cab0c9-ac65-4b88-a654-cd9bec9cb043 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:53.572892 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b3cab0c9-ac65-4b88-a654-cd9bec9cb043 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:53.574024 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b3cab0c9-ac65-4b88-a654-cd9bec9cb043 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.211979 Nov 08 16:11:53.574219 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5872069b-3ae8-4754-8bf6-dd95fdfc07b6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.218540 Nov 08 16:11:53.574575 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 70/141] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:53 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:11:53.580269 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4b33bfe5-07af-46c7-a1d3-b069b6c9b6e0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:53.580269 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4b33bfe5-07af-46c7-a1d3-b069b6c9b6e0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:53.583175 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 72/142] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:53 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:53.585424 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b33bfe5-07af-46c7-a1d3-b069b6c9b6e0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:53.585912 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b33bfe5-07af-46c7-a1d3-b069b6c9b6e0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:53.586677 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b33bfe5-07af-46c7-a1d3-b069b6c9b6e0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:53.587107 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b33bfe5-07af-46c7-a1d3-b069b6c9b6e0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:53.587741 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-67030f89-ea37-454e-a02f-ded6ac155b24 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:53.588333 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-67030f89-ea37-454e-a02f-ded6ac155b24 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:53.593881 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-67030f89-ea37-454e-a02f-ded6ac155b24 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:53.594315 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-67030f89-ea37-454e-a02f-ded6ac155b24 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:53.595061 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-67030f89-ea37-454e-a02f-ded6ac155b24 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:53.595485 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-67030f89-ea37-454e-a02f-ded6ac155b24 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:53.775728 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4b33bfe5-07af-46c7-a1d3-b069b6c9b6e0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:53.778819 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-67030f89-ea37-454e-a02f-ded6ac155b24 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:53.783234 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4b33bfe5-07af-46c7-a1d3-b069b6c9b6e0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.207709 Nov 08 16:11:53.783801 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 71/143] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:53 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:53.785920 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-67030f89-ea37-454e-a02f-ded6ac155b24 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.201521 Nov 08 16:11:53.786467 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 73/144] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:53 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:53.788617 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7cc28d5e-15fb-4582-9a26-b1a8488231a7 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:53.789213 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7cc28d5e-15fb-4582-9a26-b1a8488231a7 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:53.794707 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7cc28d5e-15fb-4582-9a26-b1a8488231a7 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:53.795151 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7cc28d5e-15fb-4582-9a26-b1a8488231a7 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:53.795918 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7cc28d5e-15fb-4582-9a26-b1a8488231a7 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:53.796352 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7cc28d5e-15fb-4582-9a26-b1a8488231a7 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:53.921390 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7cc28d5e-15fb-4582-9a26-b1a8488231a7 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:53.929031 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7cc28d5e-15fb-4582-9a26-b1a8488231a7 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.144302 Nov 08 16:11:53.929580 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 72/145] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:53 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:54.589698 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6885ef46-e5e9-4f96-bad0-d02fa82033ab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:54.590313 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6885ef46-e5e9-4f96-bad0-d02fa82033ab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:54.591302 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-8c1df1d4-ceb2-4d9a-8d52-ddba1da43f3c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:54.591904 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-8c1df1d4-ceb2-4d9a-8d52-ddba1da43f3c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:54.596197 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6885ef46-e5e9-4f96-bad0-d02fa82033ab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:54.596634 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6885ef46-e5e9-4f96-bad0-d02fa82033ab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:54.597390 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6885ef46-e5e9-4f96-bad0-d02fa82033ab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:54.597656 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8c1df1d4-ceb2-4d9a-8d52-ddba1da43f3c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:54.597843 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6885ef46-e5e9-4f96-bad0-d02fa82033ab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:54.598158 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8c1df1d4-ceb2-4d9a-8d52-ddba1da43f3c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:54.598920 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8c1df1d4-ceb2-4d9a-8d52-ddba1da43f3c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:54.599344 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8c1df1d4-ceb2-4d9a-8d52-ddba1da43f3c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:54.782984 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6885ef46-e5e9-4f96-bad0-d02fa82033ab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:54.790611 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-8c1df1d4-ceb2-4d9a-8d52-ddba1da43f3c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:54.790765 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6885ef46-e5e9-4f96-bad0-d02fa82033ab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.204637 Nov 08 16:11:54.791329 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 74/146] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:54 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:54.798845 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-8c1df1d4-ceb2-4d9a-8d52-ddba1da43f3c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:54.800419 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-8c1df1d4-ceb2-4d9a-8d52-ddba1da43f3c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:54.801507 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-8c1df1d4-ceb2-4d9a-8d52-ddba1da43f3c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.213830 Nov 08 16:11:54.802082 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 73/147] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:54 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:11:54.802614 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-fb05582d-4f70-4e85-abe0-8bd6c7886914 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:54.803205 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fb05582d-4f70-4e85-abe0-8bd6c7886914 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:54.806254 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-62114888-4851-40f3-b52f-19d45e81ae3b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:54.806836 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-62114888-4851-40f3-b52f-19d45e81ae3b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:54.809530 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fb05582d-4f70-4e85-abe0-8bd6c7886914 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:54.810189 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fb05582d-4f70-4e85-abe0-8bd6c7886914 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:54.810924 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fb05582d-4f70-4e85-abe0-8bd6c7886914 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:54.811353 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fb05582d-4f70-4e85-abe0-8bd6c7886914 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:54.813678 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-62114888-4851-40f3-b52f-19d45e81ae3b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:54.814209 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-62114888-4851-40f3-b52f-19d45e81ae3b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:54.815085 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-62114888-4851-40f3-b52f-19d45e81ae3b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:54.815555 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-62114888-4851-40f3-b52f-19d45e81ae3b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:55.002808 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fb05582d-4f70-4e85-abe0-8bd6c7886914 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:55.006052 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-62114888-4851-40f3-b52f-19d45e81ae3b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:55.009960 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-fb05582d-4f70-4e85-abe0-8bd6c7886914 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.210682 Nov 08 16:11:55.010503 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 75/148] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:54 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:55.013470 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-62114888-4851-40f3-b52f-19d45e81ae3b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.210398 Nov 08 16:11:55.014174 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 74/149] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:54 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:55.015974 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5960bfa2-1f33-4e92-b4a0-3b014632e09d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:55.016710 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5960bfa2-1f33-4e92-b4a0-3b014632e09d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:55.022875 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5960bfa2-1f33-4e92-b4a0-3b014632e09d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:55.023387 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5960bfa2-1f33-4e92-b4a0-3b014632e09d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:55.024155 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5960bfa2-1f33-4e92-b4a0-3b014632e09d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:55.024586 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5960bfa2-1f33-4e92-b4a0-3b014632e09d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:55.150835 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-5960bfa2-1f33-4e92-b4a0-3b014632e09d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:55.158091 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5960bfa2-1f33-4e92-b4a0-3b014632e09d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.145753 Nov 08 16:11:55.158656 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 76/150] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:55 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:55.807129 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-01967971-468f-4a7c-9a9c-7fd5adb5d757 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:55.807726 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-01967971-468f-4a7c-9a9c-7fd5adb5d757 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:55.814544 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-01967971-468f-4a7c-9a9c-7fd5adb5d757 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:55.815752 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-01967971-468f-4a7c-9a9c-7fd5adb5d757 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:55.816622 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-01967971-468f-4a7c-9a9c-7fd5adb5d757 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:55.817052 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-01967971-468f-4a7c-9a9c-7fd5adb5d757 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:55.819464 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-bbfc3df8-5386-4e33-a579-23b91d8e4f10 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:55.820085 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-bbfc3df8-5386-4e33-a579-23b91d8e4f10 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:55.825790 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bbfc3df8-5386-4e33-a579-23b91d8e4f10 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:55.826232 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bbfc3df8-5386-4e33-a579-23b91d8e4f10 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:55.826988 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bbfc3df8-5386-4e33-a579-23b91d8e4f10 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:55.827410 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bbfc3df8-5386-4e33-a579-23b91d8e4f10 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:56.003833 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-01967971-468f-4a7c-9a9c-7fd5adb5d757 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:56.007453 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-bbfc3df8-5386-4e33-a579-23b91d8e4f10 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:56.011689 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-01967971-468f-4a7c-9a9c-7fd5adb5d757 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.208193 Nov 08 16:11:56.012356 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 75/151] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:55 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:56.015040 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-bbfc3df8-5386-4e33-a579-23b91d8e4f10 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:56.016518 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-bbfc3df8-5386-4e33-a579-23b91d8e4f10 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:56.017599 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-bbfc3df8-5386-4e33-a579-23b91d8e4f10 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.201826 Nov 08 16:11:56.018162 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 77/152] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:55 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:11:56.029739 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-868b4484-ac50-406d-baf0-6570a330d9f9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:56.030359 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-868b4484-ac50-406d-baf0-6570a330d9f9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:56.033972 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8ff135d7-bb23-4469-b6f2-2e236796b364 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:56.034564 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8ff135d7-bb23-4469-b6f2-2e236796b364 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:56.036244 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-868b4484-ac50-406d-baf0-6570a330d9f9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:56.036694 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-868b4484-ac50-406d-baf0-6570a330d9f9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:56.037989 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-868b4484-ac50-406d-baf0-6570a330d9f9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:56.038457 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-868b4484-ac50-406d-baf0-6570a330d9f9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:56.040673 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8ff135d7-bb23-4469-b6f2-2e236796b364 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:56.041104 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8ff135d7-bb23-4469-b6f2-2e236796b364 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:56.043077 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8ff135d7-bb23-4469-b6f2-2e236796b364 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:56.043077 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8ff135d7-bb23-4469-b6f2-2e236796b364 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:56.224188 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-868b4484-ac50-406d-baf0-6570a330d9f9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:56.231533 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8ff135d7-bb23-4469-b6f2-2e236796b364 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:56.235177 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-868b4484-ac50-406d-baf0-6570a330d9f9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.208971 Nov 08 16:11:56.235746 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 76/153] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:56 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:56.239332 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8ff135d7-bb23-4469-b6f2-2e236796b364 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.208855 Nov 08 16:11:56.240030 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 78/154] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:56 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:56.240136 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-921147ba-dbf9-4eae-b3a5-862dbbc3b55d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:56.240529 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-921147ba-dbf9-4eae-b3a5-862dbbc3b55d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:56.246417 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-921147ba-dbf9-4eae-b3a5-862dbbc3b55d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:56.246850 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-921147ba-dbf9-4eae-b3a5-862dbbc3b55d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:56.247605 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-921147ba-dbf9-4eae-b3a5-862dbbc3b55d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:56.248029 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-921147ba-dbf9-4eae-b3a5-862dbbc3b55d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:56.376662 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-921147ba-dbf9-4eae-b3a5-862dbbc3b55d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:56.385205 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-921147ba-dbf9-4eae-b3a5-862dbbc3b55d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.148427 Nov 08 16:11:56.394577 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 77/155] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:56 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:57.027243 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5bb0095d-6058-42e9-9f2c-0a902574bf3f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:57.027848 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5bb0095d-6058-42e9-9f2c-0a902574bf3f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:57.033690 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5bb0095d-6058-42e9-9f2c-0a902574bf3f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:57.034157 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5bb0095d-6058-42e9-9f2c-0a902574bf3f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:57.034924 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5bb0095d-6058-42e9-9f2c-0a902574bf3f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:57.035351 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5bb0095d-6058-42e9-9f2c-0a902574bf3f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:57.035939 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-32b03fa0-846a-4f20-9567-9f26136fab94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:57.036541 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-32b03fa0-846a-4f20-9567-9f26136fab94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:57.042426 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-32b03fa0-846a-4f20-9567-9f26136fab94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:57.042866 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-32b03fa0-846a-4f20-9567-9f26136fab94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:57.043624 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-32b03fa0-846a-4f20-9567-9f26136fab94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:57.044051 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-32b03fa0-846a-4f20-9567-9f26136fab94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:57.410604 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-5bb0095d-6058-42e9-9f2c-0a902574bf3f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:57.422836 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5bb0095d-6058-42e9-9f2c-0a902574bf3f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.398985 Nov 08 16:11:57.433237 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 79/156] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:57 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:57.438199 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-dab7017f-059a-4de6-8a6e-51f1fc037b14 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:57.439042 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-dab7017f-059a-4de6-8a6e-51f1fc037b14 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:57.446818 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dab7017f-059a-4de6-8a6e-51f1fc037b14 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:57.446996 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-32b03fa0-846a-4f20-9567-9f26136fab94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:57.447709 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dab7017f-059a-4de6-8a6e-51f1fc037b14 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:57.449271 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dab7017f-059a-4de6-8a6e-51f1fc037b14 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:57.450265 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dab7017f-059a-4de6-8a6e-51f1fc037b14 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:57.457744 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-32b03fa0-846a-4f20-9567-9f26136fab94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:57.459858 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-32b03fa0-846a-4f20-9567-9f26136fab94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:57.461111 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-32b03fa0-846a-4f20-9567-9f26136fab94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.428836 Nov 08 16:11:57.462575 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 78/157] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:57 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:11:57.469505 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-537c8e29-ee88-4c29-ad5d-b6cebe7cc37c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:57.469691 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-537c8e29-ee88-4c29-ad5d-b6cebe7cc37c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:57.477447 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-537c8e29-ee88-4c29-ad5d-b6cebe7cc37c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:57.478011 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-537c8e29-ee88-4c29-ad5d-b6cebe7cc37c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:57.478771 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-537c8e29-ee88-4c29-ad5d-b6cebe7cc37c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:57.479636 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-537c8e29-ee88-4c29-ad5d-b6cebe7cc37c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:57.729156 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-dab7017f-059a-4de6-8a6e-51f1fc037b14 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:57.740722 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-dab7017f-059a-4de6-8a6e-51f1fc037b14 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.306040 Nov 08 16:11:57.743471 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 80/158] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:57 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:57.754194 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-dbd85f61-2680-48d0-8a37-17ce2b10719f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:57.755013 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-dbd85f61-2680-48d0-8a37-17ce2b10719f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:57.766003 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dbd85f61-2680-48d0-8a37-17ce2b10719f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:57.766691 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dbd85f61-2680-48d0-8a37-17ce2b10719f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:57.768563 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dbd85f61-2680-48d0-8a37-17ce2b10719f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:57.769179 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dbd85f61-2680-48d0-8a37-17ce2b10719f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:57.777833 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-537c8e29-ee88-4c29-ad5d-b6cebe7cc37c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:57.787427 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-537c8e29-ee88-4c29-ad5d-b6cebe7cc37c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.323795 Nov 08 16:11:57.789674 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 79/159] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:57 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:58.005271 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-585e8c8c-4f26-4625-b68a-f757477b9b9e req-86032056-45c7-4952-82b1-9e66ae15b252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec4f96b9-4128-4da6-9880-95a0f72fd4e2", "name": "network-vif-plugged", "status": "completed", "tag": "70c72d16-a0e9-49bb-b7b8-ef436d81a390"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:11:58.008833 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:11:58.008833 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:11:58.012945 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-dbd85f61-2680-48d0-8a37-17ce2b10719f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:58.018709 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-585e8c8c-4f26-4625-b68a-f757477b9b9e req-86032056-45c7-4952-82b1-9e66ae15b252 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:58.019381 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-585e8c8c-4f26-4625-b68a-f757477b9b9e req-86032056-45c7-4952-82b1-9e66ae15b252 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:58.023295 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-dbd85f61-2680-48d0-8a37-17ce2b10719f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.278564 Nov 08 16:11:58.023874 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 81/160] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:57 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:58.039475 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-585e8c8c-4f26-4625-b68a-f757477b9b9e req-86032056-45c7-4952-82b1-9e66ae15b252 service nova] Creating event network-vif-plugged:70c72d16-a0e9-49bb-b7b8-ef436d81a390 for instance ec4f96b9-4128-4da6-9880-95a0f72fd4e2 on hv-cinder-81618 Nov 08 16:11:58.047382 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-585e8c8c-4f26-4625-b68a-f757477b9b9e req-86032056-45c7-4952-82b1-9e66ae15b252 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149712 Nov 08 16:11:58.048254 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 80/161] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:11:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:11:58.440073 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9239b830-5f63-46b5-8231-4449f662361c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:58.440666 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-9239b830-5f63-46b5-8231-4449f662361c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:58.446490 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9239b830-5f63-46b5-8231-4449f662361c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:58.446921 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9239b830-5f63-46b5-8231-4449f662361c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:58.447671 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9239b830-5f63-46b5-8231-4449f662361c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:58.448091 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9239b830-5f63-46b5-8231-4449f662361c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:58.480438 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-12ebc44b-913c-4381-bd06-54d72ad8ed82 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:58.481124 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-12ebc44b-913c-4381-bd06-54d72ad8ed82 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:58.488040 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-12ebc44b-913c-4381-bd06-54d72ad8ed82 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:58.488489 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-12ebc44b-913c-4381-bd06-54d72ad8ed82 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:58.489269 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-12ebc44b-913c-4381-bd06-54d72ad8ed82 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:58.489694 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-12ebc44b-913c-4381-bd06-54d72ad8ed82 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:58.615946 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-9239b830-5f63-46b5-8231-4449f662361c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:58.624143 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-9239b830-5f63-46b5-8231-4449f662361c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.187273 Nov 08 16:11:58.624787 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 82/162] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:58 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:11:58.661556 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-12ebc44b-913c-4381-bd06-54d72ad8ed82 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:58.670627 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-12ebc44b-913c-4381-bd06-54d72ad8ed82 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:58.672150 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-12ebc44b-913c-4381-bd06-54d72ad8ed82 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:58.673243 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-12ebc44b-913c-4381-bd06-54d72ad8ed82 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.197023 Nov 08 16:11:58.674109 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 81/163] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:58 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:11:58.757464 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-01589e6a-2e26-4cf7-9669-0b2a5667704d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:58.758110 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-01589e6a-2e26-4cf7-9669-0b2a5667704d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:58.763999 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-01589e6a-2e26-4cf7-9669-0b2a5667704d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:58.764443 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-01589e6a-2e26-4cf7-9669-0b2a5667704d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:58.765210 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-01589e6a-2e26-4cf7-9669-0b2a5667704d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:58.765642 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-01589e6a-2e26-4cf7-9669-0b2a5667704d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:58.806265 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-40f59108-39a2-4f73-a724-5949d9194189 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:58.807063 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-40f59108-39a2-4f73-a724-5949d9194189 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:58.815270 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-40f59108-39a2-4f73-a724-5949d9194189 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:58.815822 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-40f59108-39a2-4f73-a724-5949d9194189 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:58.816749 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-40f59108-39a2-4f73-a724-5949d9194189 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:58.817248 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-40f59108-39a2-4f73-a724-5949d9194189 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:58.940051 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-01589e6a-2e26-4cf7-9669-0b2a5667704d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:58.952350 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-01589e6a-2e26-4cf7-9669-0b2a5667704d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.198416 Nov 08 16:11:58.953332 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 83/164] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:58 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:59.001589 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-40f59108-39a2-4f73-a724-5949d9194189 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:59.009910 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-40f59108-39a2-4f73-a724-5949d9194189 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.207548 Nov 08 16:11:59.010486 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 82/165] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:58 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:59.040785 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b97f01d4-5f58-47fa-87e4-9522dcc5998f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:59.041490 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b97f01d4-5f58-47fa-87e4-9522dcc5998f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:59.047607 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b97f01d4-5f58-47fa-87e4-9522dcc5998f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:59.048059 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b97f01d4-5f58-47fa-87e4-9522dcc5998f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:59.048837 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b97f01d4-5f58-47fa-87e4-9522dcc5998f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:59.049266 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b97f01d4-5f58-47fa-87e4-9522dcc5998f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:59.178756 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b97f01d4-5f58-47fa-87e4-9522dcc5998f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:59.185754 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b97f01d4-5f58-47fa-87e4-9522dcc5998f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.149408 Nov 08 16:11:59.186311 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 84/166] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:59 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:59.640869 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b6cbf53d-3353-4c27-b7b3-06718df30998 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:59.641480 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b6cbf53d-3353-4c27-b7b3-06718df30998 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:59.647370 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b6cbf53d-3353-4c27-b7b3-06718df30998 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:59.647812 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b6cbf53d-3353-4c27-b7b3-06718df30998 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:59.648573 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b6cbf53d-3353-4c27-b7b3-06718df30998 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:59.649003 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b6cbf53d-3353-4c27-b7b3-06718df30998 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:59.691396 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-505cfbfd-3afb-4361-b552-b6323afb68d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:59.692081 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-505cfbfd-3afb-4361-b552-b6323afb68d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:59.698021 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-505cfbfd-3afb-4361-b552-b6323afb68d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:59.698533 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-505cfbfd-3afb-4361-b552-b6323afb68d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:59.699370 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-505cfbfd-3afb-4361-b552-b6323afb68d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:59.699871 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-505cfbfd-3afb-4361-b552-b6323afb68d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:59.815344 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b6cbf53d-3353-4c27-b7b3-06718df30998 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:59.822873 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b6cbf53d-3353-4c27-b7b3-06718df30998 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.185670 Nov 08 16:11:59.823444 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 83/167] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:59 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:11:59.857616 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-505cfbfd-3afb-4361-b552-b6323afb68d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:59.865947 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-505cfbfd-3afb-4361-b552-b6323afb68d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:59.867425 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-505cfbfd-3afb-4361-b552-b6323afb68d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:11:59.868503 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-505cfbfd-3afb-4361-b552-b6323afb68d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.180844 Nov 08 16:11:59.869052 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 85/168] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:11:59 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:11:59.969788 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-29a3ff27-6ca3-427b-bd7c-575c65f3cf54 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:11:59.970262 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-29a3ff27-6ca3-427b-bd7c-575c65f3cf54 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:11:59.976544 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-29a3ff27-6ca3-427b-bd7c-575c65f3cf54 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:59.976982 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-29a3ff27-6ca3-427b-bd7c-575c65f3cf54 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:11:59.977749 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-29a3ff27-6ca3-427b-bd7c-575c65f3cf54 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:11:59.978177 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-29a3ff27-6ca3-427b-bd7c-575c65f3cf54 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:00.026861 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b4114a1f-1758-4677-b0b2-e95a80b7c3c5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:00.027689 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b4114a1f-1758-4677-b0b2-e95a80b7c3c5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:00.033897 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b4114a1f-1758-4677-b0b2-e95a80b7c3c5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:00.034536 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b4114a1f-1758-4677-b0b2-e95a80b7c3c5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:00.035782 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b4114a1f-1758-4677-b0b2-e95a80b7c3c5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:00.035969 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b4114a1f-1758-4677-b0b2-e95a80b7c3c5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:00.144318 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-29a3ff27-6ca3-427b-bd7c-575c65f3cf54 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:00.152131 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-29a3ff27-6ca3-427b-bd7c-575c65f3cf54 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.186041 Nov 08 16:12:00.152698 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 84/169] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:11:59 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:00.157244 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-4f5fba37-2de8-4220-809e-792b9ae4ce2a req-3e8e39ba-8627-42d7-839a-2d596f6b3fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa35d29-db7d-4fab-a001-7db0d508d70a", "name": "network-vif-plugged", "status": "completed", "tag": "4020a644-ef2e-4dd8-931a-cfccef4e7b15"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:00.158819 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:12:00.158819 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:12:00.166272 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-4f5fba37-2de8-4220-809e-792b9ae4ce2a req-3e8e39ba-8627-42d7-839a-2d596f6b3fda service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:00.166706 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-4f5fba37-2de8-4220-809e-792b9ae4ce2a req-3e8e39ba-8627-42d7-839a-2d596f6b3fda service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:00.177624 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-4f5fba37-2de8-4220-809e-792b9ae4ce2a req-3e8e39ba-8627-42d7-839a-2d596f6b3fda service nova] Creating event network-vif-plugged:4020a644-ef2e-4dd8-931a-cfccef4e7b15 for instance dfa35d29-db7d-4fab-a001-7db0d508d70a on hv-cinder-81618 Nov 08 16:12:00.183695 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-4f5fba37-2de8-4220-809e-792b9ae4ce2a req-3e8e39ba-8627-42d7-839a-2d596f6b3fda service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029448 Nov 08 16:12:00.186751 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 85/170] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:12:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:12:00.202374 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-84677985-3e60-4932-aeff-13916a574f33 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:00.203053 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-84677985-3e60-4932-aeff-13916a574f33 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:00.208024 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b4114a1f-1758-4677-b0b2-e95a80b7c3c5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:00.209756 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-84677985-3e60-4932-aeff-13916a574f33 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:00.210199 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-84677985-3e60-4932-aeff-13916a574f33 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:00.210965 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-84677985-3e60-4932-aeff-13916a574f33 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:00.211385 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-84677985-3e60-4932-aeff-13916a574f33 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:00.215813 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b4114a1f-1758-4677-b0b2-e95a80b7c3c5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.192650 Nov 08 16:12:00.216384 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 86/171] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:00 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:00.337657 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-84677985-3e60-4932-aeff-13916a574f33 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:00.344736 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-84677985-3e60-4932-aeff-13916a574f33 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.146345 Nov 08 16:12:00.345291 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 86/172] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:00 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:00.839362 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-85eebf51-4650-4bfe-9021-ee0ac8efcdf2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:00.839995 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-85eebf51-4650-4bfe-9021-ee0ac8efcdf2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:00.845909 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-85eebf51-4650-4bfe-9021-ee0ac8efcdf2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:00.846352 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-85eebf51-4650-4bfe-9021-ee0ac8efcdf2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:00.847117 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-85eebf51-4650-4bfe-9021-ee0ac8efcdf2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:00.847547 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-85eebf51-4650-4bfe-9021-ee0ac8efcdf2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:00.887025 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2b490180-ac44-485a-9cf0-99a4feac405c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:00.887627 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2b490180-ac44-485a-9cf0-99a4feac405c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:00.893387 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2b490180-ac44-485a-9cf0-99a4feac405c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:00.893857 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2b490180-ac44-485a-9cf0-99a4feac405c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:00.894618 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2b490180-ac44-485a-9cf0-99a4feac405c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:00.895042 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2b490180-ac44-485a-9cf0-99a4feac405c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:01.011568 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-85eebf51-4650-4bfe-9021-ee0ac8efcdf2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:01.019605 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-85eebf51-4650-4bfe-9021-ee0ac8efcdf2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.183652 Nov 08 16:12:01.020272 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 87/173] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:00 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:01.074911 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-2b490180-ac44-485a-9cf0-99a4feac405c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:01.085222 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-2b490180-ac44-485a-9cf0-99a4feac405c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:01.086746 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-2b490180-ac44-485a-9cf0-99a4feac405c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:01.088099 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2b490180-ac44-485a-9cf0-99a4feac405c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.204519 Nov 08 16:12:01.088404 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 87/174] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:12:00 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:12:01.168449 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-072ab560-73f3-42f5-bf0d-0a295fbb8e23 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:01.169306 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-072ab560-73f3-42f5-bf0d-0a295fbb8e23 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:01.175777 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-072ab560-73f3-42f5-bf0d-0a295fbb8e23 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:01.176302 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-072ab560-73f3-42f5-bf0d-0a295fbb8e23 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:01.177171 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-072ab560-73f3-42f5-bf0d-0a295fbb8e23 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:01.178300 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-072ab560-73f3-42f5-bf0d-0a295fbb8e23 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:01.233595 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-44797852-3042-4988-8ad3-251610b35f7d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:01.234663 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-44797852-3042-4988-8ad3-251610b35f7d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:01.242634 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-44797852-3042-4988-8ad3-251610b35f7d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:01.243085 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-44797852-3042-4988-8ad3-251610b35f7d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:01.243948 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-44797852-3042-4988-8ad3-251610b35f7d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:01.244379 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-44797852-3042-4988-8ad3-251610b35f7d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:01.344243 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-072ab560-73f3-42f5-bf0d-0a295fbb8e23 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:01.351709 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-072ab560-73f3-42f5-bf0d-0a295fbb8e23 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.186851 Nov 08 16:12:01.352538 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 88/175] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:01 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:01.361726 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1c6f219c-94d7-4fd7-9f8a-8ebbd10fadde tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:01.362360 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1c6f219c-94d7-4fd7-9f8a-8ebbd10fadde tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:01.368374 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1c6f219c-94d7-4fd7-9f8a-8ebbd10fadde tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:01.368817 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1c6f219c-94d7-4fd7-9f8a-8ebbd10fadde tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:01.369584 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1c6f219c-94d7-4fd7-9f8a-8ebbd10fadde tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:01.370040 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1c6f219c-94d7-4fd7-9f8a-8ebbd10fadde tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:01.408778 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-44797852-3042-4988-8ad3-251610b35f7d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:01.416889 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-44797852-3042-4988-8ad3-251610b35f7d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.187467 Nov 08 16:12:01.417582 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 88/176] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:01 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:01.507894 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1c6f219c-94d7-4fd7-9f8a-8ebbd10fadde tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:01.515610 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1c6f219c-94d7-4fd7-9f8a-8ebbd10fadde tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.157384 Nov 08 16:12:01.516172 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 89/177] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:01 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:02.036072 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-45d1584d-dd41-4516-8b94-62c5c5e8f904 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:02.036722 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-45d1584d-dd41-4516-8b94-62c5c5e8f904 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:02.042615 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-45d1584d-dd41-4516-8b94-62c5c5e8f904 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:02.043053 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-45d1584d-dd41-4516-8b94-62c5c5e8f904 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:02.043809 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-45d1584d-dd41-4516-8b94-62c5c5e8f904 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:02.044230 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-45d1584d-dd41-4516-8b94-62c5c5e8f904 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:02.105138 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-7f27d199-7a75-4a91-9e93-a51fff858dc9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:02.105920 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-7f27d199-7a75-4a91-9e93-a51fff858dc9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:02.112021 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7f27d199-7a75-4a91-9e93-a51fff858dc9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:02.112666 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7f27d199-7a75-4a91-9e93-a51fff858dc9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:02.113414 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7f27d199-7a75-4a91-9e93-a51fff858dc9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:02.113945 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7f27d199-7a75-4a91-9e93-a51fff858dc9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:02.209074 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-45d1584d-dd41-4516-8b94-62c5c5e8f904 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:02.216853 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-45d1584d-dd41-4516-8b94-62c5c5e8f904 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.184322 Nov 08 16:12:02.217673 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 89/178] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:02 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:02.228221 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-3466e708-fd2e-4272-a4d5-cf1a5a908b51 req-6af08002-8019-49a8-a9e0-a0dd14f258ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "name": "network-vif-plugged", "status": "completed", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:02.229899 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:12:02.229899 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:12:02.237373 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-3466e708-fd2e-4272-a4d5-cf1a5a908b51 req-6af08002-8019-49a8-a9e0-a0dd14f258ee service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:02.237845 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-3466e708-fd2e-4272-a4d5-cf1a5a908b51 req-6af08002-8019-49a8-a9e0-a0dd14f258ee service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:02.249125 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-3466e708-fd2e-4272-a4d5-cf1a5a908b51 req-6af08002-8019-49a8-a9e0-a0dd14f258ee service nova] Creating event network-vif-plugged:fbefda08-fc7a-42a0-b714-6dea3d8a5161 for instance 1c1c8c8d-5f78-45fb-803d-8f7a84df3433 on hv-cinder-81618 Nov 08 16:12:02.259393 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-3466e708-fd2e-4272-a4d5-cf1a5a908b51 req-6af08002-8019-49a8-a9e0-a0dd14f258ee service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030698 Nov 08 16:12:02.259393 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 90/179] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:12:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:12:02.275715 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7f27d199-7a75-4a91-9e93-a51fff858dc9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:02.283369 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7f27d199-7a75-4a91-9e93-a51fff858dc9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:02.284863 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7f27d199-7a75-4a91-9e93-a51fff858dc9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:02.286013 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-7f27d199-7a75-4a91-9e93-a51fff858dc9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.184587 Nov 08 16:12:02.286568 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 90/180] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:12:02 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:12:02.369001 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2650c331-0573-4834-8f5e-0f61890228ba tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:02.369681 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2650c331-0573-4834-8f5e-0f61890228ba tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:02.376276 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2650c331-0573-4834-8f5e-0f61890228ba tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:02.376731 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2650c331-0573-4834-8f5e-0f61890228ba tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:02.377558 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2650c331-0573-4834-8f5e-0f61890228ba tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:02.378014 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2650c331-0573-4834-8f5e-0f61890228ba tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:02.434206 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-28e597a3-8c6f-42b3-bbea-1820765ff321 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:02.434917 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-28e597a3-8c6f-42b3-bbea-1820765ff321 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:02.440857 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-28e597a3-8c6f-42b3-bbea-1820765ff321 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:02.441410 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-28e597a3-8c6f-42b3-bbea-1820765ff321 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:02.442322 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-28e597a3-8c6f-42b3-bbea-1820765ff321 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:02.443450 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-28e597a3-8c6f-42b3-bbea-1820765ff321 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:02.535475 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-2650c331-0573-4834-8f5e-0f61890228ba tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:02.542751 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2650c331-0573-4834-8f5e-0f61890228ba tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.178147 Nov 08 16:12:02.543621 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 91/181] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:02 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:02.547776 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7ec19844-ede7-46f3-893b-57da29ec0ca2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:02.548359 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7ec19844-ede7-46f3-893b-57da29ec0ca2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:02.554752 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7ec19844-ede7-46f3-893b-57da29ec0ca2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:02.555188 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7ec19844-ede7-46f3-893b-57da29ec0ca2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:02.555944 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7ec19844-ede7-46f3-893b-57da29ec0ca2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:02.556368 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7ec19844-ede7-46f3-893b-57da29ec0ca2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:02.605401 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-28e597a3-8c6f-42b3-bbea-1820765ff321 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:02.612744 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-28e597a3-8c6f-42b3-bbea-1820765ff321 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.182267 Nov 08 16:12:02.613302 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 91/182] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:02 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:02.690272 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7ec19844-ede7-46f3-893b-57da29ec0ca2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:02.697420 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7ec19844-ede7-46f3-893b-57da29ec0ca2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.153002 Nov 08 16:12:02.698045 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 92/183] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:02 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:03.233284 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1f1f1bb7-5bcb-4fbf-b1a5-cb2995c7dd27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:03.233914 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1f1f1bb7-5bcb-4fbf-b1a5-cb2995c7dd27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:03.239643 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1f1f1bb7-5bcb-4fbf-b1a5-cb2995c7dd27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:03.240087 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1f1f1bb7-5bcb-4fbf-b1a5-cb2995c7dd27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:03.240844 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1f1f1bb7-5bcb-4fbf-b1a5-cb2995c7dd27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:03.241269 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1f1f1bb7-5bcb-4fbf-b1a5-cb2995c7dd27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:03.303519 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-63f1bebb-0388-4b85-834d-ec393ac55c00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:03.304788 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-63f1bebb-0388-4b85-834d-ec393ac55c00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:03.310612 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-63f1bebb-0388-4b85-834d-ec393ac55c00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:03.311059 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-63f1bebb-0388-4b85-834d-ec393ac55c00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:03.311838 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-63f1bebb-0388-4b85-834d-ec393ac55c00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:03.312273 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-63f1bebb-0388-4b85-834d-ec393ac55c00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:03.390893 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1f1f1bb7-5bcb-4fbf-b1a5-cb2995c7dd27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:03.398985 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1f1f1bb7-5bcb-4fbf-b1a5-cb2995c7dd27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.169232 Nov 08 16:12:03.399561 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 92/184] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:03 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:03.461573 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-63f1bebb-0388-4b85-834d-ec393ac55c00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:03.469263 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-63f1bebb-0388-4b85-834d-ec393ac55c00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:03.470772 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-63f1bebb-0388-4b85-834d-ec393ac55c00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:03.471852 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-63f1bebb-0388-4b85-834d-ec393ac55c00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.172117 Nov 08 16:12:03.472395 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 93/185] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:12:03 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:12:03.559095 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-37176392-8aba-4a82-ba1b-2aea8990740b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:03.559684 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-37176392-8aba-4a82-ba1b-2aea8990740b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:03.565376 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-37176392-8aba-4a82-ba1b-2aea8990740b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:03.565845 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-37176392-8aba-4a82-ba1b-2aea8990740b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:03.566602 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-37176392-8aba-4a82-ba1b-2aea8990740b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:03.567027 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-37176392-8aba-4a82-ba1b-2aea8990740b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:03.641469 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5653287e-5e3d-4a2f-a340-ceb3fd0c3d7a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:03.642275 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5653287e-5e3d-4a2f-a340-ceb3fd0c3d7a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:03.650812 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5653287e-5e3d-4a2f-a340-ceb3fd0c3d7a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:03.651063 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5653287e-5e3d-4a2f-a340-ceb3fd0c3d7a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:03.652086 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5653287e-5e3d-4a2f-a340-ceb3fd0c3d7a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:03.652781 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5653287e-5e3d-4a2f-a340-ceb3fd0c3d7a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:03.765365 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-37176392-8aba-4a82-ba1b-2aea8990740b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:03.773835 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-37176392-8aba-4a82-ba1b-2aea8990740b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.218209 Nov 08 16:12:03.774411 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 93/186] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:03 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:03.780726 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-76571458-3b6a-4f1e-b710-a9dcafaa5a75 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:03.781334 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-76571458-3b6a-4f1e-b710-a9dcafaa5a75 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:03.788443 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-76571458-3b6a-4f1e-b710-a9dcafaa5a75 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:03.788882 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-76571458-3b6a-4f1e-b710-a9dcafaa5a75 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:03.789839 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-76571458-3b6a-4f1e-b710-a9dcafaa5a75 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:03.790259 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-76571458-3b6a-4f1e-b710-a9dcafaa5a75 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:03.832997 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-5653287e-5e3d-4a2f-a340-ceb3fd0c3d7a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:03.840322 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5653287e-5e3d-4a2f-a340-ceb3fd0c3d7a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.213868 Nov 08 16:12:03.850800 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 94/187] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:03 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:03.992258 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-76571458-3b6a-4f1e-b710-a9dcafaa5a75 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:03.999920 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-76571458-3b6a-4f1e-b710-a9dcafaa5a75 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.223937 Nov 08 16:12:04.000549 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 94/188] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:03 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:04.415307 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1cac1e22-31b8-4332-a3a4-3adc97984131 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:04.415909 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1cac1e22-31b8-4332-a3a4-3adc97984131 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:04.421642 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1cac1e22-31b8-4332-a3a4-3adc97984131 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:04.422115 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1cac1e22-31b8-4332-a3a4-3adc97984131 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:04.422872 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1cac1e22-31b8-4332-a3a4-3adc97984131 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:04.423331 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1cac1e22-31b8-4332-a3a4-3adc97984131 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:04.489345 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f389e7a2-4c1c-4be8-aef2-7198032fd680 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:04.489921 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f389e7a2-4c1c-4be8-aef2-7198032fd680 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:04.495626 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f389e7a2-4c1c-4be8-aef2-7198032fd680 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:04.496114 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f389e7a2-4c1c-4be8-aef2-7198032fd680 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:04.496945 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f389e7a2-4c1c-4be8-aef2-7198032fd680 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:04.497365 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f389e7a2-4c1c-4be8-aef2-7198032fd680 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:04.580209 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1cac1e22-31b8-4332-a3a4-3adc97984131 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:04.588126 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1cac1e22-31b8-4332-a3a4-3adc97984131 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.176169 Nov 08 16:12:04.588830 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 95/189] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:04 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:04.642198 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f389e7a2-4c1c-4be8-aef2-7198032fd680 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:04.650313 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f389e7a2-4c1c-4be8-aef2-7198032fd680 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:04.651801 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f389e7a2-4c1c-4be8-aef2-7198032fd680 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:04.652879 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f389e7a2-4c1c-4be8-aef2-7198032fd680 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.167345 Nov 08 16:12:04.653430 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 95/190] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:12:04 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:12:04.791230 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-629fbc85-18a3-49b8-8063-c8793522e980 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:04.791819 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-629fbc85-18a3-49b8-8063-c8793522e980 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:04.797582 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-629fbc85-18a3-49b8-8063-c8793522e980 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:04.798047 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-629fbc85-18a3-49b8-8063-c8793522e980 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:04.798807 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-629fbc85-18a3-49b8-8063-c8793522e980 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:04.799225 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-629fbc85-18a3-49b8-8063-c8793522e980 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:04.857055 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-84c34d32-d278-4d56-aada-bfb3cdd4d602 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:04.857651 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-84c34d32-d278-4d56-aada-bfb3cdd4d602 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:04.863452 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84c34d32-d278-4d56-aada-bfb3cdd4d602 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:04.864178 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84c34d32-d278-4d56-aada-bfb3cdd4d602 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:04.864954 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84c34d32-d278-4d56-aada-bfb3cdd4d602 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:04.865379 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84c34d32-d278-4d56-aada-bfb3cdd4d602 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:04.954014 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-629fbc85-18a3-49b8-8063-c8793522e980 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:04.962196 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-629fbc85-18a3-49b8-8063-c8793522e980 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.174466 Nov 08 16:12:04.962765 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 96/191] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:04 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:05.016132 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-47060996-31b6-41aa-9fd3-b82aab9ce2e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:05.016957 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-47060996-31b6-41aa-9fd3-b82aab9ce2e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:05.018751 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-84c34d32-d278-4d56-aada-bfb3cdd4d602 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:05.023338 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-47060996-31b6-41aa-9fd3-b82aab9ce2e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:05.023795 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-47060996-31b6-41aa-9fd3-b82aab9ce2e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:05.024558 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-47060996-31b6-41aa-9fd3-b82aab9ce2e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:05.024979 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-47060996-31b6-41aa-9fd3-b82aab9ce2e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:05.026473 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-84c34d32-d278-4d56-aada-bfb3cdd4d602 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.173517 Nov 08 16:12:05.027038 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 96/192] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:04 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:05.150191 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-47060996-31b6-41aa-9fd3-b82aab9ce2e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:05.157395 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-47060996-31b6-41aa-9fd3-b82aab9ce2e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.144968 Nov 08 16:12:05.157970 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 97/193] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:05 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:05.605558 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-97e7b27b-41c8-4d08-9d97-2c1637ef8253 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:05.606163 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-97e7b27b-41c8-4d08-9d97-2c1637ef8253 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:05.611914 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-97e7b27b-41c8-4d08-9d97-2c1637ef8253 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:05.612360 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-97e7b27b-41c8-4d08-9d97-2c1637ef8253 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:05.613122 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-97e7b27b-41c8-4d08-9d97-2c1637ef8253 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:05.613552 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-97e7b27b-41c8-4d08-9d97-2c1637ef8253 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:05.671173 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-275a5197-cab0-4877-a82c-a853545294a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:05.671788 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-275a5197-cab0-4877-a82c-a853545294a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:05.678057 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-275a5197-cab0-4877-a82c-a853545294a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:05.678757 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-275a5197-cab0-4877-a82c-a853545294a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:05.679528 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-275a5197-cab0-4877-a82c-a853545294a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:05.679956 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-275a5197-cab0-4877-a82c-a853545294a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:05.777497 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-97e7b27b-41c8-4d08-9d97-2c1637ef8253 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:05.784752 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-97e7b27b-41c8-4d08-9d97-2c1637ef8253 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.182880 Nov 08 16:12:05.788997 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 97/194] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:05 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:05.824926 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-9a5bc1b2-83fc-4801-901f-d8e7b1a84b6f req-45d195a3-c89f-4804-b6f5-9d09fc9df6bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a953f3-d586-4495-b2d1-3c6e6cd89a52", "name": "network-vif-plugged", "status": "completed", "tag": "3e7ad14a-6975-4075-ac69-3a504ad24341"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:05.826815 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:12:05.826815 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:12:05.834732 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-9a5bc1b2-83fc-4801-901f-d8e7b1a84b6f req-45d195a3-c89f-4804-b6f5-9d09fc9df6bb service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:05.835366 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-9a5bc1b2-83fc-4801-901f-d8e7b1a84b6f req-45d195a3-c89f-4804-b6f5-9d09fc9df6bb service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:05.841742 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-275a5197-cab0-4877-a82c-a853545294a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:05.847629 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-9a5bc1b2-83fc-4801-901f-d8e7b1a84b6f req-45d195a3-c89f-4804-b6f5-9d09fc9df6bb service nova] Creating event network-vif-plugged:3e7ad14a-6975-4075-ac69-3a504ad24341 for instance a3a953f3-d586-4495-b2d1-3c6e6cd89a52 on hv-cinder-81618 Nov 08 16:12:05.849755 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-275a5197-cab0-4877-a82c-a853545294a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:05.851243 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-275a5197-cab0-4877-a82c-a853545294a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:05.852330 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-275a5197-cab0-4877-a82c-a853545294a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.184935 Nov 08 16:12:05.857820 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 98/195] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:12:05 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:12:05.857976 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-9a5bc1b2-83fc-4801-901f-d8e7b1a84b6f req-45d195a3-c89f-4804-b6f5-9d09fc9df6bb service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031649 Nov 08 16:12:05.857976 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 98/196] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:12:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:12:05.979346 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-24ff2389-eba7-42ed-bbfc-ed46c22c8cfd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:05.979971 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-24ff2389-eba7-42ed-bbfc-ed46c22c8cfd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:05.985963 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-24ff2389-eba7-42ed-bbfc-ed46c22c8cfd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:05.986402 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-24ff2389-eba7-42ed-bbfc-ed46c22c8cfd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:05.987157 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-24ff2389-eba7-42ed-bbfc-ed46c22c8cfd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:05.987580 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-24ff2389-eba7-42ed-bbfc-ed46c22c8cfd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:06.044289 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4b887212-227f-47e7-8e32-2825fa6b7843 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:06.045252 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4b887212-227f-47e7-8e32-2825fa6b7843 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:06.051628 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4b887212-227f-47e7-8e32-2825fa6b7843 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:06.052230 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4b887212-227f-47e7-8e32-2825fa6b7843 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:06.053008 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4b887212-227f-47e7-8e32-2825fa6b7843 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:06.053438 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4b887212-227f-47e7-8e32-2825fa6b7843 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:06.151235 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-24ff2389-eba7-42ed-bbfc-ed46c22c8cfd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:06.159195 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-24ff2389-eba7-42ed-bbfc-ed46c22c8cfd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.183456 Nov 08 16:12:06.159756 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 99/197] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:05 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:06.174242 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-66461086-14bf-48a4-b428-89382dc6d718 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:06.175114 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-66461086-14bf-48a4-b428-89382dc6d718 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:06.181507 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-66461086-14bf-48a4-b428-89382dc6d718 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:06.182102 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-66461086-14bf-48a4-b428-89382dc6d718 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:06.182872 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-66461086-14bf-48a4-b428-89382dc6d718 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:06.183380 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-66461086-14bf-48a4-b428-89382dc6d718 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:06.214505 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4b887212-227f-47e7-8e32-2825fa6b7843 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:06.222266 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4b887212-227f-47e7-8e32-2825fa6b7843 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.182129 Nov 08 16:12:06.222831 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 99/198] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:06 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:06.311430 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-66461086-14bf-48a4-b428-89382dc6d718 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:06.325039 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-66461086-14bf-48a4-b428-89382dc6d718 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.148420 Nov 08 16:12:06.325039 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 100/199] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:06 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:06.802578 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-118b4357-877f-4f59-969b-75efafe76fe0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:06.803184 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-118b4357-877f-4f59-969b-75efafe76fe0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:06.808932 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-118b4357-877f-4f59-969b-75efafe76fe0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:06.809372 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-118b4357-877f-4f59-969b-75efafe76fe0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:06.810306 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-118b4357-877f-4f59-969b-75efafe76fe0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:06.810623 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-118b4357-877f-4f59-969b-75efafe76fe0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:06.870956 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c97ffe91-bd59-4e04-aa1c-bab88fa364b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:06.871639 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c97ffe91-bd59-4e04-aa1c-bab88fa364b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:06.877766 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c97ffe91-bd59-4e04-aa1c-bab88fa364b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:06.878277 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c97ffe91-bd59-4e04-aa1c-bab88fa364b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:06.879101 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c97ffe91-bd59-4e04-aa1c-bab88fa364b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:06.879592 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c97ffe91-bd59-4e04-aa1c-bab88fa364b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:06.964381 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-118b4357-877f-4f59-969b-75efafe76fe0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:06.971501 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-118b4357-877f-4f59-969b-75efafe76fe0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.173099 Nov 08 16:12:06.972068 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 100/200] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:06 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:07.028290 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c97ffe91-bd59-4e04-aa1c-bab88fa364b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:07.035867 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c97ffe91-bd59-4e04-aa1c-bab88fa364b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:07.037398 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c97ffe91-bd59-4e04-aa1c-bab88fa364b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:07.038506 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c97ffe91-bd59-4e04-aa1c-bab88fa364b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.171450 Nov 08 16:12:07.039055 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 101/201] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:12:06 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:12:07.176604 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f090ddff-1569-4dee-9a3d-54fa24eeb6d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:07.177799 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f090ddff-1569-4dee-9a3d-54fa24eeb6d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:07.183605 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f090ddff-1569-4dee-9a3d-54fa24eeb6d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:07.184050 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f090ddff-1569-4dee-9a3d-54fa24eeb6d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:07.184840 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f090ddff-1569-4dee-9a3d-54fa24eeb6d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:07.185269 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f090ddff-1569-4dee-9a3d-54fa24eeb6d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:07.239335 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2eb3e53e-421f-45bf-a75a-c60e30818e9c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:07.240433 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2eb3e53e-421f-45bf-a75a-c60e30818e9c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:07.246106 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2eb3e53e-421f-45bf-a75a-c60e30818e9c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:07.246547 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2eb3e53e-421f-45bf-a75a-c60e30818e9c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:07.247329 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2eb3e53e-421f-45bf-a75a-c60e30818e9c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:07.247746 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2eb3e53e-421f-45bf-a75a-c60e30818e9c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:07.343508 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f090ddff-1569-4dee-9a3d-54fa24eeb6d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:07.351082 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f090ddff-1569-4dee-9a3d-54fa24eeb6d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.178128 Nov 08 16:12:07.351640 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 101/202] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:07 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:07.355805 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-45de91a7-d4de-4435-b77c-dcf75bc9cda5 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:07.356421 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-45de91a7-d4de-4435-b77c-dcf75bc9cda5 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:07.362095 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-45de91a7-d4de-4435-b77c-dcf75bc9cda5 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:07.362541 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-45de91a7-d4de-4435-b77c-dcf75bc9cda5 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:07.363308 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-45de91a7-d4de-4435-b77c-dcf75bc9cda5 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:07.363744 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-45de91a7-d4de-4435-b77c-dcf75bc9cda5 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:07.413579 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-2eb3e53e-421f-45bf-a75a-c60e30818e9c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:07.420731 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2eb3e53e-421f-45bf-a75a-c60e30818e9c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.185141 Nov 08 16:12:07.421397 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 102/203] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:07 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:07.494139 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-45de91a7-d4de-4435-b77c-dcf75bc9cda5 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:07.501481 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-45de91a7-d4de-4435-b77c-dcf75bc9cda5 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.148917 Nov 08 16:12:07.502077 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 102/204] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:07 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:07.987902 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-01939058-97e2-4271-9cb5-5d2f0b159aca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:07.988503 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-01939058-97e2-4271-9cb5-5d2f0b159aca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:07.995008 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-01939058-97e2-4271-9cb5-5d2f0b159aca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:07.995451 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-01939058-97e2-4271-9cb5-5d2f0b159aca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:07.996210 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-01939058-97e2-4271-9cb5-5d2f0b159aca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:07.996637 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-01939058-97e2-4271-9cb5-5d2f0b159aca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:08.056155 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-cbda86de-b6a9-4c0e-a917-1896ffe2a38a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:08.056703 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-cbda86de-b6a9-4c0e-a917-1896ffe2a38a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:08.062317 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cbda86de-b6a9-4c0e-a917-1896ffe2a38a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:08.062755 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cbda86de-b6a9-4c0e-a917-1896ffe2a38a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:08.063517 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cbda86de-b6a9-4c0e-a917-1896ffe2a38a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:08.063940 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cbda86de-b6a9-4c0e-a917-1896ffe2a38a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:08.153693 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-01939058-97e2-4271-9cb5-5d2f0b159aca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:08.161255 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-01939058-97e2-4271-9cb5-5d2f0b159aca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.176954 Nov 08 16:12:08.162425 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 103/205] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:07 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:08.216424 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-cbda86de-b6a9-4c0e-a917-1896ffe2a38a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:08.224669 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-cbda86de-b6a9-4c0e-a917-1896ffe2a38a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:08.226195 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-cbda86de-b6a9-4c0e-a917-1896ffe2a38a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:08.227272 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-cbda86de-b6a9-4c0e-a917-1896ffe2a38a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.175387 Nov 08 16:12:08.227818 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 103/206] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:12:08 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:12:08.367823 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-035dffa7-5ec0-495a-a731-0dea626c4ac1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:08.368347 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-035dffa7-5ec0-495a-a731-0dea626c4ac1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:08.374431 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-035dffa7-5ec0-495a-a731-0dea626c4ac1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:08.374872 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-035dffa7-5ec0-495a-a731-0dea626c4ac1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:08.375634 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-035dffa7-5ec0-495a-a731-0dea626c4ac1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:08.376060 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-035dffa7-5ec0-495a-a731-0dea626c4ac1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:08.436615 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e166c6f5-4756-4d3a-99d6-5443eed79987 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:08.437207 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e166c6f5-4756-4d3a-99d6-5443eed79987 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:08.443003 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e166c6f5-4756-4d3a-99d6-5443eed79987 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:08.443439 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e166c6f5-4756-4d3a-99d6-5443eed79987 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:08.444194 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e166c6f5-4756-4d3a-99d6-5443eed79987 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:08.444612 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e166c6f5-4756-4d3a-99d6-5443eed79987 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:08.528676 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-035dffa7-5ec0-495a-a731-0dea626c4ac1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:08.535803 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-035dffa7-5ec0-495a-a731-0dea626c4ac1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.171809 Nov 08 16:12:08.536379 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 104/207] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:08 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:08.540528 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1fa9f5ba-18b7-4d8a-a693-faa0d412e8d2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:08.541117 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1fa9f5ba-18b7-4d8a-a693-faa0d412e8d2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:08.547353 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1fa9f5ba-18b7-4d8a-a693-faa0d412e8d2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:08.547803 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1fa9f5ba-18b7-4d8a-a693-faa0d412e8d2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:08.548573 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1fa9f5ba-18b7-4d8a-a693-faa0d412e8d2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:08.549006 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1fa9f5ba-18b7-4d8a-a693-faa0d412e8d2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:08.615228 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-e166c6f5-4756-4d3a-99d6-5443eed79987 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:08.622637 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e166c6f5-4756-4d3a-99d6-5443eed79987 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.189597 Nov 08 16:12:08.623779 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 104/208] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:08 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:08.682372 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1fa9f5ba-18b7-4d8a-a693-faa0d412e8d2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:08.689416 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1fa9f5ba-18b7-4d8a-a693-faa0d412e8d2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.152113 Nov 08 16:12:08.690018 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 105/209] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:08 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:08.983107 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-d216d2ad-ea42-4852-97e5-0811217758f2 req-ddd17f56-94f2-4119-9d76-46a509a480dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76ed94d-63f4-4597-be02-f3fc032b85aa", "name": "network-vif-plugged", "status": "completed", "tag": "f4784d76-6af7-4b31-a9f3-ee25c9087b51"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:08.984799 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:12:08.984799 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:12:08.992070 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-d216d2ad-ea42-4852-97e5-0811217758f2 req-ddd17f56-94f2-4119-9d76-46a509a480dc service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:08.992544 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-d216d2ad-ea42-4852-97e5-0811217758f2 req-ddd17f56-94f2-4119-9d76-46a509a480dc service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:09.004739 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-d216d2ad-ea42-4852-97e5-0811217758f2 req-ddd17f56-94f2-4119-9d76-46a509a480dc service nova] Creating event network-vif-plugged:f4784d76-6af7-4b31-a9f3-ee25c9087b51 for instance b76ed94d-63f4-4597-be02-f3fc032b85aa on hv-cinder-81618 Nov 08 16:12:09.010115 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-d216d2ad-ea42-4852-97e5-0811217758f2 req-ddd17f56-94f2-4119-9d76-46a509a480dc service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030614 Nov 08 16:12:09.010685 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 105/210] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:12:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:12:09.178245 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0eb75afd-a95c-47a7-ac4f-9c0bc68bd5b2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:09.178922 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0eb75afd-a95c-47a7-ac4f-9c0bc68bd5b2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:09.185321 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0eb75afd-a95c-47a7-ac4f-9c0bc68bd5b2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:09.185803 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0eb75afd-a95c-47a7-ac4f-9c0bc68bd5b2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:09.186743 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0eb75afd-a95c-47a7-ac4f-9c0bc68bd5b2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:09.187202 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0eb75afd-a95c-47a7-ac4f-9c0bc68bd5b2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:09.245288 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3cd33a0c-b589-4001-84b0-5e3505bb85b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:09.246131 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3cd33a0c-b589-4001-84b0-5e3505bb85b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:09.253382 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3cd33a0c-b589-4001-84b0-5e3505bb85b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:09.254059 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3cd33a0c-b589-4001-84b0-5e3505bb85b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:09.254824 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3cd33a0c-b589-4001-84b0-5e3505bb85b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:09.256671 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3cd33a0c-b589-4001-84b0-5e3505bb85b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:09.353043 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0eb75afd-a95c-47a7-ac4f-9c0bc68bd5b2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:09.365870 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0eb75afd-a95c-47a7-ac4f-9c0bc68bd5b2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.191914 Nov 08 16:12:09.366452 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 106/211] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:09 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:09.408376 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3cd33a0c-b589-4001-84b0-5e3505bb85b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:09.416464 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3cd33a0c-b589-4001-84b0-5e3505bb85b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:09.417978 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3cd33a0c-b589-4001-84b0-5e3505bb85b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:09.419054 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3cd33a0c-b589-4001-84b0-5e3505bb85b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.177838 Nov 08 16:12:09.419596 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 106/212] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:12:09 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:12:09.552738 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-94859b7c-207e-44fd-af72-4d8d33e92f0b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:09.553337 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-94859b7c-207e-44fd-af72-4d8d33e92f0b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:09.559273 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-94859b7c-207e-44fd-af72-4d8d33e92f0b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:09.559719 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-94859b7c-207e-44fd-af72-4d8d33e92f0b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:09.560478 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-94859b7c-207e-44fd-af72-4d8d33e92f0b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:09.560911 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-94859b7c-207e-44fd-af72-4d8d33e92f0b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:09.639590 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-94298b9f-182a-4a3b-ae8a-cdced294d9d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:09.640481 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-94298b9f-182a-4a3b-ae8a-cdced294d9d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:09.646724 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-94298b9f-182a-4a3b-ae8a-cdced294d9d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:09.647268 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-94298b9f-182a-4a3b-ae8a-cdced294d9d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:09.648271 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-94298b9f-182a-4a3b-ae8a-cdced294d9d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:09.648873 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-94298b9f-182a-4a3b-ae8a-cdced294d9d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:09.698320 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-94859b7c-207e-44fd-af72-4d8d33e92f0b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:09.705666 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-94859b7c-207e-44fd-af72-4d8d33e92f0b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.157128 Nov 08 16:12:09.715232 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 107/213] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:09 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:09.715232 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-6febb94e-69f0-4cc6-843c-2405c83a73dd tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:09.715232 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-6febb94e-69f0-4cc6-843c-2405c83a73dd tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:09.717030 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6febb94e-69f0-4cc6-843c-2405c83a73dd tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:09.717532 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6febb94e-69f0-4cc6-843c-2405c83a73dd tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:09.718401 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6febb94e-69f0-4cc6-843c-2405c83a73dd tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:09.718895 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6febb94e-69f0-4cc6-843c-2405c83a73dd tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:09.809867 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-94298b9f-182a-4a3b-ae8a-cdced294d9d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:09.817240 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-94298b9f-182a-4a3b-ae8a-cdced294d9d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.181662 Nov 08 16:12:09.817868 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 107/214] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:09 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:09.871064 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-6febb94e-69f0-4cc6-843c-2405c83a73dd tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:09.878838 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-6febb94e-69f0-4cc6-843c-2405c83a73dd tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.171497 Nov 08 16:12:09.879437 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 108/215] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:09 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:10.383111 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e18896ce-7223-4b26-9adb-556794644db5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:10.383643 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e18896ce-7223-4b26-9adb-556794644db5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:10.389533 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e18896ce-7223-4b26-9adb-556794644db5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:10.390012 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e18896ce-7223-4b26-9adb-556794644db5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:10.390773 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e18896ce-7223-4b26-9adb-556794644db5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:10.391204 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e18896ce-7223-4b26-9adb-556794644db5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:10.436171 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ace43867-4554-49f6-a575-1586f71c15c3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:10.436864 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ace43867-4554-49f6-a575-1586f71c15c3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:10.443135 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ace43867-4554-49f6-a575-1586f71c15c3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:10.443648 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ace43867-4554-49f6-a575-1586f71c15c3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:10.444475 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ace43867-4554-49f6-a575-1586f71c15c3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:10.444903 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ace43867-4554-49f6-a575-1586f71c15c3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:10.556521 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-e18896ce-7223-4b26-9adb-556794644db5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:10.564205 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e18896ce-7223-4b26-9adb-556794644db5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.185214 Nov 08 16:12:10.565120 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 108/216] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:10 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:10.600403 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-ace43867-4554-49f6-a575-1586f71c15c3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:10.608086 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-ace43867-4554-49f6-a575-1586f71c15c3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:10.609585 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-ace43867-4554-49f6-a575-1586f71c15c3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:10.610698 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ace43867-4554-49f6-a575-1586f71c15c3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.178220 Nov 08 16:12:10.611258 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 109/217] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:12:10 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:12:10.722050 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9e440c84-cf6a-42ac-8217-e4c0e84cb042 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:10.722649 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-9e440c84-cf6a-42ac-8217-e4c0e84cb042 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:10.728403 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9e440c84-cf6a-42ac-8217-e4c0e84cb042 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:10.728844 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9e440c84-cf6a-42ac-8217-e4c0e84cb042 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:10.729602 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9e440c84-cf6a-42ac-8217-e4c0e84cb042 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:10.730056 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9e440c84-cf6a-42ac-8217-e4c0e84cb042 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:10.834275 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5ff6f7a3-9075-40bf-839d-c54533a5d36c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:10.834953 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5ff6f7a3-9075-40bf-839d-c54533a5d36c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:10.846989 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5ff6f7a3-9075-40bf-839d-c54533a5d36c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:10.846989 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5ff6f7a3-9075-40bf-839d-c54533a5d36c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:10.846989 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5ff6f7a3-9075-40bf-839d-c54533a5d36c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:10.846989 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5ff6f7a3-9075-40bf-839d-c54533a5d36c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:10.869887 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-9e440c84-cf6a-42ac-8217-e4c0e84cb042 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:10.877394 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-9e440c84-cf6a-42ac-8217-e4c0e84cb042 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.158959 Nov 08 16:12:10.877988 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 109/218] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:10 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:10.894884 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d2d12d2a-5a37-4107-8f02-089edb8da581 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:10.895479 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d2d12d2a-5a37-4107-8f02-089edb8da581 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:10.901335 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d2d12d2a-5a37-4107-8f02-089edb8da581 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:10.901899 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d2d12d2a-5a37-4107-8f02-089edb8da581 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:10.902592 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d2d12d2a-5a37-4107-8f02-089edb8da581 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:10.903028 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d2d12d2a-5a37-4107-8f02-089edb8da581 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:10.999435 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-5ff6f7a3-9075-40bf-839d-c54533a5d36c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:11.007129 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5ff6f7a3-9075-40bf-839d-c54533a5d36c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.176774 Nov 08 16:12:11.007688 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 110/219] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:10 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:11.031204 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-dfe575c4-4991-4c40-88c5-1a2db251dc17 req-a771dc85-00c6-435e-b8d2-9706d73632fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f7e3a8-0064-42ad-9e41-03a1ba050703", "name": "network-vif-plugged", "status": "completed", "tag": "17db566c-bf28-4091-b7f6-4ffa5f80c982"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:11.032764 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:12:11.032764 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:12:11.039489 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-dfe575c4-4991-4c40-88c5-1a2db251dc17 req-a771dc85-00c6-435e-b8d2-9706d73632fe service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:11.039928 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-dfe575c4-4991-4c40-88c5-1a2db251dc17 req-a771dc85-00c6-435e-b8d2-9706d73632fe service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:11.050545 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-dfe575c4-4991-4c40-88c5-1a2db251dc17 req-a771dc85-00c6-435e-b8d2-9706d73632fe service nova] Creating event network-vif-plugged:17db566c-bf28-4091-b7f6-4ffa5f80c982 for instance 44f7e3a8-0064-42ad-9e41-03a1ba050703 on hv-cinder-81618 Nov 08 16:12:11.055619 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-dfe575c4-4991-4c40-88c5-1a2db251dc17 req-a771dc85-00c6-435e-b8d2-9706d73632fe service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027856 Nov 08 16:12:11.056201 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 111/220] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:12:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:12:11.058293 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d2d12d2a-5a37-4107-8f02-089edb8da581 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:11.065434 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d2d12d2a-5a37-4107-8f02-089edb8da581 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.174124 Nov 08 16:12:11.066002 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 110/221] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:10 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:11.582067 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2442124b-56d8-4f9a-8da5-cbdefd32af1d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:11.582756 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2442124b-56d8-4f9a-8da5-cbdefd32af1d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:11.588790 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2442124b-56d8-4f9a-8da5-cbdefd32af1d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:11.589233 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2442124b-56d8-4f9a-8da5-cbdefd32af1d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:11.590037 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2442124b-56d8-4f9a-8da5-cbdefd32af1d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:11.590460 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2442124b-56d8-4f9a-8da5-cbdefd32af1d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:11.628379 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-68f13aed-0653-4aeb-8bfe-3affe3151cfc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:11.629054 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-68f13aed-0653-4aeb-8bfe-3affe3151cfc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:11.635348 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-68f13aed-0653-4aeb-8bfe-3affe3151cfc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:11.635786 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-68f13aed-0653-4aeb-8bfe-3affe3151cfc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:11.636552 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-68f13aed-0653-4aeb-8bfe-3affe3151cfc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:11.636976 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-68f13aed-0653-4aeb-8bfe-3affe3151cfc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:11.956860 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-2442124b-56d8-4f9a-8da5-cbdefd32af1d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:11.965547 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2442124b-56d8-4f9a-8da5-cbdefd32af1d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.387438 Nov 08 16:12:11.967526 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 112/222] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:11 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:11.978697 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-33f49044-d71f-4d73-80f9-b1ac17ada1e5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:11.979543 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-33f49044-d71f-4d73-80f9-b1ac17ada1e5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:11.985467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-33f49044-d71f-4d73-80f9-b1ac17ada1e5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:11.985973 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-33f49044-d71f-4d73-80f9-b1ac17ada1e5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:11.986745 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-33f49044-d71f-4d73-80f9-b1ac17ada1e5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:11.987174 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-33f49044-d71f-4d73-80f9-b1ac17ada1e5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:11.996720 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-68f13aed-0653-4aeb-8bfe-3affe3151cfc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:12.004759 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-68f13aed-0653-4aeb-8bfe-3affe3151cfc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:12.006293 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-68f13aed-0653-4aeb-8bfe-3affe3151cfc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:12.007472 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-68f13aed-0653-4aeb-8bfe-3affe3151cfc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.382729 Nov 08 16:12:12.007946 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 111/223] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:12:11 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:12:12.023862 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-26fcb921-932c-42a7-928e-a7c3b73aa1e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:12.024566 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-26fcb921-932c-42a7-928e-a7c3b73aa1e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:12.030567 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-26fcb921-932c-42a7-928e-a7c3b73aa1e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:12.031086 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-26fcb921-932c-42a7-928e-a7c3b73aa1e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:12.031858 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-26fcb921-932c-42a7-928e-a7c3b73aa1e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:12.032287 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-26fcb921-932c-42a7-928e-a7c3b73aa1e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:12.146510 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-33f49044-d71f-4d73-80f9-b1ac17ada1e5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:12.153794 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-33f49044-d71f-4d73-80f9-b1ac17ada1e5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.186206 Nov 08 16:12:12.154433 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 113/224] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:11 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:12.159030 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c6ee58ba-924b-46ed-a645-476f3f6502ff tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:12.159148 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c6ee58ba-924b-46ed-a645-476f3f6502ff tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:12.164633 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c6ee58ba-924b-46ed-a645-476f3f6502ff tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:12.165070 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c6ee58ba-924b-46ed-a645-476f3f6502ff tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:12.165851 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c6ee58ba-924b-46ed-a645-476f3f6502ff tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:12.166273 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c6ee58ba-924b-46ed-a645-476f3f6502ff tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:12.190193 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-26fcb921-932c-42a7-928e-a7c3b73aa1e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:12.198587 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-26fcb921-932c-42a7-928e-a7c3b73aa1e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1318 microversion: 2.1 time: 0.178667 Nov 08 16:12:12.199490 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 112/225] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:12 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:12.322318 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c6ee58ba-924b-46ed-a645-476f3f6502ff tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:12.329350 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c6ee58ba-924b-46ed-a645-476f3f6502ff tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1314 microversion: 2.1 time: 0.174000 Nov 08 16:12:12.329931 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 114/226] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:12 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:12.982537 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-85d7acfb-1cb9-4683-819c-4d8a50d3bdc0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:12.983065 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-85d7acfb-1cb9-4683-819c-4d8a50d3bdc0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:12.988822 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-85d7acfb-1cb9-4683-819c-4d8a50d3bdc0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:12.989772 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-85d7acfb-1cb9-4683-819c-4d8a50d3bdc0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:12.990532 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-85d7acfb-1cb9-4683-819c-4d8a50d3bdc0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:12.990951 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-85d7acfb-1cb9-4683-819c-4d8a50d3bdc0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:13.023958 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-115fbb36-f2a4-41dd-a745-c0f3fa1a5cdf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:13.024634 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-115fbb36-f2a4-41dd-a745-c0f3fa1a5cdf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:13.038796 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-115fbb36-f2a4-41dd-a745-c0f3fa1a5cdf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:13.039252 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-115fbb36-f2a4-41dd-a745-c0f3fa1a5cdf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:13.040048 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-115fbb36-f2a4-41dd-a745-c0f3fa1a5cdf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:13.040476 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-115fbb36-f2a4-41dd-a745-c0f3fa1a5cdf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:13.169109 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-85d7acfb-1cb9-4683-819c-4d8a50d3bdc0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:13.176773 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-85d7acfb-1cb9-4683-819c-4d8a50d3bdc0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1322 microversion: 2.1 time: 0.197743 Nov 08 16:12:13.178547 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 113/227] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:12 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:13.184766 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8eccbdd9-720e-45b2-9268-c62e7334e5f7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:13.185638 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8eccbdd9-720e-45b2-9268-c62e7334e5f7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:13.192944 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8eccbdd9-720e-45b2-9268-c62e7334e5f7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:13.193384 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8eccbdd9-720e-45b2-9268-c62e7334e5f7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:13.194487 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8eccbdd9-720e-45b2-9268-c62e7334e5f7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:13.194876 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8eccbdd9-720e-45b2-9268-c62e7334e5f7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:13.227280 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-115fbb36-f2a4-41dd-a745-c0f3fa1a5cdf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:13.244184 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-115fbb36-f2a4-41dd-a745-c0f3fa1a5cdf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:13.245674 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-115fbb36-f2a4-41dd-a745-c0f3fa1a5cdf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:13.247249 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-115fbb36-f2a4-41dd-a745-c0f3fa1a5cdf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1408 microversion: 2.20 time: 0.226456 Nov 08 16:12:13.257970 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 115/228] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:12:13 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:12:13.262597 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b8aaa526-e46f-4c7a-80a4-eddba36aba2b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:13.263262 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b8aaa526-e46f-4c7a-80a4-eddba36aba2b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:13.269131 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b8aaa526-e46f-4c7a-80a4-eddba36aba2b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:13.269546 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b8aaa526-e46f-4c7a-80a4-eddba36aba2b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:13.270334 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b8aaa526-e46f-4c7a-80a4-eddba36aba2b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:13.270789 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b8aaa526-e46f-4c7a-80a4-eddba36aba2b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:13.399875 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8eccbdd9-720e-45b2-9268-c62e7334e5f7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:13.407797 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8eccbdd9-720e-45b2-9268-c62e7334e5f7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.227957 Nov 08 16:12:13.408374 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 114/229] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:13 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:13.425629 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-2ea5f4fb-4b7d-49dd-b154-f2d1ec8f3066 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:13.426315 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-2ea5f4fb-4b7d-49dd-b154-f2d1ec8f3066 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:13.433073 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2ea5f4fb-4b7d-49dd-b154-f2d1ec8f3066 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:13.434026 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2ea5f4fb-4b7d-49dd-b154-f2d1ec8f3066 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:13.434984 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2ea5f4fb-4b7d-49dd-b154-f2d1ec8f3066 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:13.435594 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2ea5f4fb-4b7d-49dd-b154-f2d1ec8f3066 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:13.447071 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b8aaa526-e46f-4c7a-80a4-eddba36aba2b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:13.454563 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b8aaa526-e46f-4c7a-80a4-eddba36aba2b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1508 microversion: 2.1 time: 0.195494 Nov 08 16:12:13.466431 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 116/230] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:13 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1508 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:13.569447 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-2ea5f4fb-4b7d-49dd-b154-f2d1ec8f3066 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:13.576590 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-2ea5f4fb-4b7d-49dd-b154-f2d1ec8f3066 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1501 microversion: 2.1 time: 0.167284 Nov 08 16:12:13.577371 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 115/231] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:13 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:14.194145 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-67813cdf-a1da-4101-a40b-da1e1fb86eb8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:14.194737 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-67813cdf-a1da-4101-a40b-da1e1fb86eb8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:14.200615 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-67813cdf-a1da-4101-a40b-da1e1fb86eb8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:14.201051 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-67813cdf-a1da-4101-a40b-da1e1fb86eb8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:14.201999 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-67813cdf-a1da-4101-a40b-da1e1fb86eb8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:14.202593 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-67813cdf-a1da-4101-a40b-da1e1fb86eb8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:14.265251 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0804fa69-170d-4930-845c-f4000074109c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:14.265981 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0804fa69-170d-4930-845c-f4000074109c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:14.272324 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0804fa69-170d-4930-845c-f4000074109c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:14.272761 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0804fa69-170d-4930-845c-f4000074109c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:14.273532 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0804fa69-170d-4930-845c-f4000074109c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:14.273986 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0804fa69-170d-4930-845c-f4000074109c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:14.370733 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-67813cdf-a1da-4101-a40b-da1e1fb86eb8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:14.378436 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-67813cdf-a1da-4101-a40b-da1e1fb86eb8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1516 microversion: 2.1 time: 0.188526 Nov 08 16:12:14.379006 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 117/232] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:14 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:14.395554 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-572c82de-0c05-4e05-acd4-7ac3138d39fd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:14.396781 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-572c82de-0c05-4e05-acd4-7ac3138d39fd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:14.402774 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-572c82de-0c05-4e05-acd4-7ac3138d39fd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:14.403219 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-572c82de-0c05-4e05-acd4-7ac3138d39fd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:14.403981 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-572c82de-0c05-4e05-acd4-7ac3138d39fd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:14.404406 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-572c82de-0c05-4e05-acd4-7ac3138d39fd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:14.435795 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0804fa69-170d-4930-845c-f4000074109c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:14.444051 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0804fa69-170d-4930-845c-f4000074109c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:14.445551 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0804fa69-170d-4930-845c-f4000074109c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:14.446719 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0804fa69-170d-4930-845c-f4000074109c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1600 microversion: 2.20 time: 0.185501 Nov 08 16:12:14.447271 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 116/233] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:12:14 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1600 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:12:14.451520 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c4b061d5-111c-46f3-ba3d-78df719a167e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:14.452116 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c4b061d5-111c-46f3-ba3d-78df719a167e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:14.457848 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c4b061d5-111c-46f3-ba3d-78df719a167e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:14.458505 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c4b061d5-111c-46f3-ba3d-78df719a167e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:14.459514 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c4b061d5-111c-46f3-ba3d-78df719a167e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:14.459702 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c4b061d5-111c-46f3-ba3d-78df719a167e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:14.468127 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.objects.instance [None req-572c82de-0c05-4e05-acd4-7ac3138d39fd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lazy-loading 'flavor' on Instance uuid a3a953f3-d586-4495-b2d1-3c6e6cd89a52 {{(pid=115524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:12:14.582987 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-572c82de-0c05-4e05-acd4-7ac3138d39fd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "POST /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52/action" status: 200 len: 32 microversion: 2.1 time: 0.190924 Nov 08 16:12:14.583725 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 118/234] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:14 2021] POST /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52/action => generated 32 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 08 16:12:14.589142 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-137fd7c4-8962-457d-ae01-38aa1ab52bee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:14.589764 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-137fd7c4-8962-457d-ae01-38aa1ab52bee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:14.593321 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c4b061d5-111c-46f3-ba3d-78df719a167e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:14.595904 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-137fd7c4-8962-457d-ae01-38aa1ab52bee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:14.596353 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-137fd7c4-8962-457d-ae01-38aa1ab52bee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:14.597183 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-137fd7c4-8962-457d-ae01-38aa1ab52bee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:14.597616 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-137fd7c4-8962-457d-ae01-38aa1ab52bee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:14.603211 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c4b061d5-111c-46f3-ba3d-78df719a167e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1362 microversion: 2.1 time: 0.154896 Nov 08 16:12:14.603933 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 117/235] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:14 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:14.608352 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1bfb35cf-6fb1-4299-ad11-8e0a002f6b26 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:14.609031 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1bfb35cf-6fb1-4299-ad11-8e0a002f6b26 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:14.615828 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1bfb35cf-6fb1-4299-ad11-8e0a002f6b26 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:14.616414 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1bfb35cf-6fb1-4299-ad11-8e0a002f6b26 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:14.617183 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1bfb35cf-6fb1-4299-ad11-8e0a002f6b26 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:14.617607 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1bfb35cf-6fb1-4299-ad11-8e0a002f6b26 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:14.746936 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-137fd7c4-8962-457d-ae01-38aa1ab52bee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.161881 Nov 08 16:12:14.751731 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 119/236] 10.222.0.37 () {60 vars in 1315 bytes} [Mon Nov 8 16:12:14 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:12:14.811790 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-829730b2-c4f6-4f9d-b7c2-cded75fbebfe tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0345609c-84ca-4607-b487-e6cb821e3dac"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:14.813749 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-829730b2-c4f6-4f9d-b7c2-cded75fbebfe tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:14.821500 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-829730b2-c4f6-4f9d-b7c2-cded75fbebfe tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:14.822418 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-829730b2-c4f6-4f9d-b7c2-cded75fbebfe tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:14.822976 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-829730b2-c4f6-4f9d-b7c2-cded75fbebfe tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:14.823423 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-829730b2-c4f6-4f9d-b7c2-cded75fbebfe tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:14.929132 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1bfb35cf-6fb1-4299-ad11-8e0a002f6b26 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:14.940562 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1bfb35cf-6fb1-4299-ad11-8e0a002f6b26 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.335400 Nov 08 16:12:14.941340 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 118/237] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:14 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:15.331469 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-829730b2-c4f6-4f9d-b7c2-cded75fbebfe tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "POST /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.526154 Nov 08 16:12:15.337443 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 120/238] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Nov 8 16:12:14 2021] POST /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a/os-volume_attachments => generated 194 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:12:15.621168 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-360be09f-233a-4786-a819-5ee4c7cc6dbd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:15.621899 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-360be09f-233a-4786-a819-5ee4c7cc6dbd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:15.628605 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-360be09f-233a-4786-a819-5ee4c7cc6dbd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:15.629039 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-360be09f-233a-4786-a819-5ee4c7cc6dbd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:15.629860 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-360be09f-233a-4786-a819-5ee4c7cc6dbd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:15.630279 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-360be09f-233a-4786-a819-5ee4c7cc6dbd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:15.792352 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-360be09f-233a-4786-a819-5ee4c7cc6dbd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:15.807397 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-360be09f-233a-4786-a819-5ee4c7cc6dbd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1547 microversion: 2.1 time: 0.188075 Nov 08 16:12:15.807974 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 119/239] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:15 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1547 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:15.825201 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1f751dfd-721b-42f5-a2ea-c79d3870104e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:15.825821 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1f751dfd-721b-42f5-a2ea-c79d3870104e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:15.832522 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1f751dfd-721b-42f5-a2ea-c79d3870104e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:15.833520 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1f751dfd-721b-42f5-a2ea-c79d3870104e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:15.834362 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1f751dfd-721b-42f5-a2ea-c79d3870104e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:15.834822 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1f751dfd-721b-42f5-a2ea-c79d3870104e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:15.914685 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1f751dfd-721b-42f5-a2ea-c79d3870104e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093786 Nov 08 16:12:15.915288 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 121/240] 10.222.0.37 () {58 vars in 1274 bytes} [Mon Nov 8 16:12:15 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:12:15.960238 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-74b2ee68-f1d6-405f-89aa-b4785adf6cd4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:15.961524 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-74b2ee68-f1d6-405f-89aa-b4785adf6cd4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:15.968071 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-74b2ee68-f1d6-405f-89aa-b4785adf6cd4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:15.968868 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-74b2ee68-f1d6-405f-89aa-b4785adf6cd4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:15.970331 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-74b2ee68-f1d6-405f-89aa-b4785adf6cd4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:15.972015 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-74b2ee68-f1d6-405f-89aa-b4785adf6cd4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:16.090340 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-cde0e717-932c-4eb6-b92f-312e5799f627 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25cd0b74-99d2-4a03-b00b-d6a16723919c"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:16.092095 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-cde0e717-932c-4eb6-b92f-312e5799f627 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:16.100719 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cde0e717-932c-4eb6-b92f-312e5799f627 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:16.101507 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cde0e717-932c-4eb6-b92f-312e5799f627 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:16.102626 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cde0e717-932c-4eb6-b92f-312e5799f627 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:16.103209 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cde0e717-932c-4eb6-b92f-312e5799f627 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:16.330052 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-74b2ee68-f1d6-405f-89aa-b4785adf6cd4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:16.341235 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-74b2ee68-f1d6-405f-89aa-b4785adf6cd4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.382308 Nov 08 16:12:16.342064 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 120/241] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:15 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:16.391380 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3a30099b-4e44-415c-a9b6-bee62637fa5d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:16.392486 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3a30099b-4e44-415c-a9b6-bee62637fa5d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:16.404297 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3a30099b-4e44-415c-a9b6-bee62637fa5d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:16.406303 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3a30099b-4e44-415c-a9b6-bee62637fa5d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:16.407348 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3a30099b-4e44-415c-a9b6-bee62637fa5d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:16.408818 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3a30099b-4e44-415c-a9b6-bee62637fa5d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:16.505310 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-cde0e717-932c-4eb6-b92f-312e5799f627 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "POST /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.419187 Nov 08 16:12:16.513314 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 122/242] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Nov 8 16:12:16 2021] POST /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2/os-volume_attachments => generated 194 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:12:16.530432 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-8ed37142-88f0-44eb-81e6-47e3607adcd5 req-5a0ec4e5-77e1-49f6-9db0-e6945fabfd0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:16.534452 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:12:16.534452 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:12:16.551500 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-8ed37142-88f0-44eb-81e6-47e3607adcd5 req-5a0ec4e5-77e1-49f6-9db0-e6945fabfd0f service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:16.552590 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-8ed37142-88f0-44eb-81e6-47e3607adcd5 req-5a0ec4e5-77e1-49f6-9db0-e6945fabfd0f service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:16.564877 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3a30099b-4e44-415c-a9b6-bee62637fa5d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 14 microversion: 2.20 time: 0.175797 Nov 08 16:12:16.568854 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 121/243] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:16 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:16.572702 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-8ed37142-88f0-44eb-81e6-47e3607adcd5 req-5a0ec4e5-77e1-49f6-9db0-e6945fabfd0f service nova] Creating event network-changed:fbefda08-fc7a-42a0-b714-6dea3d8a5161 for instance 1c1c8c8d-5f78-45fb-803d-8f7a84df3433 on hv-cinder-81618 Nov 08 16:12:16.579587 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-8ed37142-88f0-44eb-81e6-47e3607adcd5 req-5a0ec4e5-77e1-49f6-9db0-e6945fabfd0f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064002 Nov 08 16:12:16.580503 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 123/244] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:12:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:12:17.360551 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ee5a8887-1192-465f-a284-b97636f233c3 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:17.361381 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ee5a8887-1192-465f-a284-b97636f233c3 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:17.368971 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ee5a8887-1192-465f-a284-b97636f233c3 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:17.371520 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ee5a8887-1192-465f-a284-b97636f233c3 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:17.373154 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ee5a8887-1192-465f-a284-b97636f233c3 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:17.374349 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ee5a8887-1192-465f-a284-b97636f233c3 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:17.576950 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4624de6e-ee30-4e47-8312-2119f2c842dd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:17.578106 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4624de6e-ee30-4e47-8312-2119f2c842dd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:17.585320 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4624de6e-ee30-4e47-8312-2119f2c842dd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:17.585925 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4624de6e-ee30-4e47-8312-2119f2c842dd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:17.586795 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4624de6e-ee30-4e47-8312-2119f2c842dd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:17.587342 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4624de6e-ee30-4e47-8312-2119f2c842dd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:17.675863 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4624de6e-ee30-4e47-8312-2119f2c842dd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 14 microversion: 2.20 time: 0.102739 Nov 08 16:12:17.682720 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 124/245] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:17 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:17.736597 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ee5a8887-1192-465f-a284-b97636f233c3 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:17.745273 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ee5a8887-1192-465f-a284-b97636f233c3 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.388932 Nov 08 16:12:17.746653 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 122/246] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:17 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:18.428612 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-410421f2-779e-45ec-9f0a-db7326bf0cf3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:18.429625 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-410421f2-779e-45ec-9f0a-db7326bf0cf3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:18.434299 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-33dc3fd7-d7ce-4291-ab3d-2a913b62cf45 req-e84fb760-bee4-4176-abc4-6a96b1b72377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b76ed94d-63f4-4597-be02-f3fc032b85aa", "tag": "f4784d76-6af7-4b31-a9f3-ee25c9087b51"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:18.436549 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-410421f2-779e-45ec-9f0a-db7326bf0cf3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:18.437000 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-410421f2-779e-45ec-9f0a-db7326bf0cf3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:18.438019 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-410421f2-779e-45ec-9f0a-db7326bf0cf3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:18.438605 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-410421f2-779e-45ec-9f0a-db7326bf0cf3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:18.438951 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:12:18.438951 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:12:18.456030 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-33dc3fd7-d7ce-4291-ab3d-2a913b62cf45 req-e84fb760-bee4-4176-abc4-6a96b1b72377 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:18.457240 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-33dc3fd7-d7ce-4291-ab3d-2a913b62cf45 req-e84fb760-bee4-4176-abc4-6a96b1b72377 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:18.473901 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-33dc3fd7-d7ce-4291-ab3d-2a913b62cf45 req-e84fb760-bee4-4176-abc4-6a96b1b72377 service nova] Creating event network-changed:f4784d76-6af7-4b31-a9f3-ee25c9087b51 for instance b76ed94d-63f4-4597-be02-f3fc032b85aa on hv-cinder-81618 Nov 08 16:12:18.479032 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-33dc3fd7-d7ce-4291-ab3d-2a913b62cf45 req-e84fb760-bee4-4176-abc4-6a96b1b72377 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051811 Nov 08 16:12:18.480142 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 123/247] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:12:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:12:18.518855 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-410421f2-779e-45ec-9f0a-db7326bf0cf3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 14 microversion: 2.1 time: 0.094165 Nov 08 16:12:18.521007 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 125/248] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:18 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:12:18.688911 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0389648b-d51e-4643-9cb4-e83d6c7aec41 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:18.690154 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0389648b-d51e-4643-9cb4-e83d6c7aec41 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:18.703515 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0389648b-d51e-4643-9cb4-e83d6c7aec41 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:18.703977 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0389648b-d51e-4643-9cb4-e83d6c7aec41 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:18.717317 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0389648b-d51e-4643-9cb4-e83d6c7aec41 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:18.717866 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0389648b-d51e-4643-9cb4-e83d6c7aec41 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:18.765698 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c599dc20-8b88-4533-b4b2-5ffbfc1873e2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:18.766404 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c599dc20-8b88-4533-b4b2-5ffbfc1873e2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:18.774598 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c599dc20-8b88-4533-b4b2-5ffbfc1873e2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:18.775039 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c599dc20-8b88-4533-b4b2-5ffbfc1873e2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:18.776133 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c599dc20-8b88-4533-b4b2-5ffbfc1873e2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:18.776754 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c599dc20-8b88-4533-b4b2-5ffbfc1873e2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:18.844172 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0389648b-d51e-4643-9cb4-e83d6c7aec41 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 14 microversion: 2.20 time: 0.159211 Nov 08 16:12:18.848418 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 124/249] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:18 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:19.048798 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c599dc20-8b88-4533-b4b2-5ffbfc1873e2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:19.056703 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c599dc20-8b88-4533-b4b2-5ffbfc1873e2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.296698 Nov 08 16:12:19.057271 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 126/250] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:18 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:19.534061 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-defc4559-46e2-4e99-ba7b-13a774dedffc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:19.535080 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-defc4559-46e2-4e99-ba7b-13a774dedffc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:19.542806 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-defc4559-46e2-4e99-ba7b-13a774dedffc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:19.543423 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-defc4559-46e2-4e99-ba7b-13a774dedffc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:19.544517 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-defc4559-46e2-4e99-ba7b-13a774dedffc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:19.544796 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-defc4559-46e2-4e99-ba7b-13a774dedffc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:19.639486 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-defc4559-46e2-4e99-ba7b-13a774dedffc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 14 microversion: 2.1 time: 0.110211 Nov 08 16:12:19.641311 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 125/251] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:19 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:12:19.856249 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-99341bc2-3f97-431f-949a-d86b2481840b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:19.857220 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-99341bc2-3f97-431f-949a-d86b2481840b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:19.863465 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-99341bc2-3f97-431f-949a-d86b2481840b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:19.864007 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-99341bc2-3f97-431f-949a-d86b2481840b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:19.864780 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-99341bc2-3f97-431f-949a-d86b2481840b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:19.865206 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-99341bc2-3f97-431f-949a-d86b2481840b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:19.931492 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-99341bc2-3f97-431f-949a-d86b2481840b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 14 microversion: 2.20 time: 0.079494 Nov 08 16:12:19.932123 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 127/252] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:19 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:20.075793 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-07ef7feb-38d3-4bb5-8c6f-21653b1c0f3f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:20.082355 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-07ef7feb-38d3-4bb5-8c6f-21653b1c0f3f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:20.097499 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-07ef7feb-38d3-4bb5-8c6f-21653b1c0f3f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:20.097968 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-07ef7feb-38d3-4bb5-8c6f-21653b1c0f3f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:20.104980 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-07ef7feb-38d3-4bb5-8c6f-21653b1c0f3f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:20.105429 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-07ef7feb-38d3-4bb5-8c6f-21653b1c0f3f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:20.322332 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-07ef7feb-38d3-4bb5-8c6f-21653b1c0f3f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:20.331040 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-07ef7feb-38d3-4bb5-8c6f-21653b1c0f3f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.260678 Nov 08 16:12:20.331691 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 126/253] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:20 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:20.652136 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-37912dba-4693-4931-8322-c931bc2ec839 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:20.653424 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-37912dba-4693-4931-8322-c931bc2ec839 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:20.660688 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-37912dba-4693-4931-8322-c931bc2ec839 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:20.661293 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-37912dba-4693-4931-8322-c931bc2ec839 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:20.662158 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-37912dba-4693-4931-8322-c931bc2ec839 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:20.662648 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-37912dba-4693-4931-8322-c931bc2ec839 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:20.761762 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-37912dba-4693-4931-8322-c931bc2ec839 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 14 microversion: 2.1 time: 0.113430 Nov 08 16:12:20.762476 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 128/254] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:20 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:12:20.943571 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f2d5d9d4-e737-4dd9-97ce-f64356459c85 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:20.945673 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f2d5d9d4-e737-4dd9-97ce-f64356459c85 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:20.952226 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f2d5d9d4-e737-4dd9-97ce-f64356459c85 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:20.952881 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f2d5d9d4-e737-4dd9-97ce-f64356459c85 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:20.953836 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f2d5d9d4-e737-4dd9-97ce-f64356459c85 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:20.954427 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f2d5d9d4-e737-4dd9-97ce-f64356459c85 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:21.021875 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f2d5d9d4-e737-4dd9-97ce-f64356459c85 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 14 microversion: 2.20 time: 0.082835 Nov 08 16:12:21.023135 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 127/255] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:20 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:21.353377 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a06f471c-026d-493a-a0ef-5114f9a99cd8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:21.353377 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a06f471c-026d-493a-a0ef-5114f9a99cd8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:21.358042 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a06f471c-026d-493a-a0ef-5114f9a99cd8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:21.358596 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a06f471c-026d-493a-a0ef-5114f9a99cd8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:21.359505 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a06f471c-026d-493a-a0ef-5114f9a99cd8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:21.360041 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a06f471c-026d-493a-a0ef-5114f9a99cd8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:21.505743 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a06f471c-026d-493a-a0ef-5114f9a99cd8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:21.513197 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a06f471c-026d-493a-a0ef-5114f9a99cd8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.167892 Nov 08 16:12:21.514052 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 129/256] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:21 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:21.773962 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b1bd25ff-3672-4539-b19d-f287fcacaed0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:21.775306 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b1bd25ff-3672-4539-b19d-f287fcacaed0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:21.783542 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b1bd25ff-3672-4539-b19d-f287fcacaed0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:21.783984 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b1bd25ff-3672-4539-b19d-f287fcacaed0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:21.785090 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b1bd25ff-3672-4539-b19d-f287fcacaed0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:21.786039 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b1bd25ff-3672-4539-b19d-f287fcacaed0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:21.911789 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b1bd25ff-3672-4539-b19d-f287fcacaed0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 14 microversion: 2.1 time: 0.140366 Nov 08 16:12:21.915341 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 128/257] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:21 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:12:22.032746 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3e3cb15a-ab25-4026-9135-46c03bbbf326 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:22.033671 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3e3cb15a-ab25-4026-9135-46c03bbbf326 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:22.040308 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3e3cb15a-ab25-4026-9135-46c03bbbf326 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:22.040843 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3e3cb15a-ab25-4026-9135-46c03bbbf326 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:22.041947 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3e3cb15a-ab25-4026-9135-46c03bbbf326 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:22.042482 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3e3cb15a-ab25-4026-9135-46c03bbbf326 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:22.117067 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3e3cb15a-ab25-4026-9135-46c03bbbf326 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 14 microversion: 2.20 time: 0.088120 Nov 08 16:12:22.117733 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 130/258] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:22 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:22.531887 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d8b5d19f-3670-40ce-a4ff-94beaccd87f9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:22.533168 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d8b5d19f-3670-40ce-a4ff-94beaccd87f9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:22.540340 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d8b5d19f-3670-40ce-a4ff-94beaccd87f9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:22.541207 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d8b5d19f-3670-40ce-a4ff-94beaccd87f9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:22.542174 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d8b5d19f-3670-40ce-a4ff-94beaccd87f9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:22.542789 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d8b5d19f-3670-40ce-a4ff-94beaccd87f9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:22.736923 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d8b5d19f-3670-40ce-a4ff-94beaccd87f9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:22.744580 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d8b5d19f-3670-40ce-a4ff-94beaccd87f9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.217348 Nov 08 16:12:22.745445 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 129/259] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:22 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:22.923705 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9a06a5ea-4184-4f9f-b91e-90299f462f89 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:22.924697 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9a06a5ea-4184-4f9f-b91e-90299f462f89 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:22.930946 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9a06a5ea-4184-4f9f-b91e-90299f462f89 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:22.931574 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9a06a5ea-4184-4f9f-b91e-90299f462f89 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:22.932499 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9a06a5ea-4184-4f9f-b91e-90299f462f89 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:22.932945 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9a06a5ea-4184-4f9f-b91e-90299f462f89 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:23.019727 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9a06a5ea-4184-4f9f-b91e-90299f462f89 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 14 microversion: 2.1 time: 0.100133 Nov 08 16:12:23.020904 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 131/260] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:22 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:12:23.128212 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-2b7fc2eb-bf42-4691-a0a1-7dc809c70c1c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:23.129105 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-2b7fc2eb-bf42-4691-a0a1-7dc809c70c1c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:23.135910 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2b7fc2eb-bf42-4691-a0a1-7dc809c70c1c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:23.136342 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2b7fc2eb-bf42-4691-a0a1-7dc809c70c1c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:23.137285 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2b7fc2eb-bf42-4691-a0a1-7dc809c70c1c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:23.137701 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2b7fc2eb-bf42-4691-a0a1-7dc809c70c1c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:23.205996 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-2b7fc2eb-bf42-4691-a0a1-7dc809c70c1c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 14 microversion: 2.20 time: 0.081231 Nov 08 16:12:23.209171 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 130/261] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:23 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:23.761955 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c2bca9ce-cadd-40d4-9b91-1184accb2878 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:23.762665 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c2bca9ce-cadd-40d4-9b91-1184accb2878 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:23.770508 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c2bca9ce-cadd-40d4-9b91-1184accb2878 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:23.770947 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c2bca9ce-cadd-40d4-9b91-1184accb2878 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:23.771724 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c2bca9ce-cadd-40d4-9b91-1184accb2878 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:23.772153 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c2bca9ce-cadd-40d4-9b91-1184accb2878 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:23.918878 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c2bca9ce-cadd-40d4-9b91-1184accb2878 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:23.927290 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c2bca9ce-cadd-40d4-9b91-1184accb2878 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.169297 Nov 08 16:12:23.928186 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 132/262] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:23 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:24.032725 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0966bcea-7691-43a3-b426-30d15d181944 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:24.034227 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0966bcea-7691-43a3-b426-30d15d181944 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:24.041986 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0966bcea-7691-43a3-b426-30d15d181944 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:24.043162 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0966bcea-7691-43a3-b426-30d15d181944 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:24.044110 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0966bcea-7691-43a3-b426-30d15d181944 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:24.044696 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0966bcea-7691-43a3-b426-30d15d181944 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:24.138466 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0966bcea-7691-43a3-b426-30d15d181944 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 14 microversion: 2.1 time: 0.110580 Nov 08 16:12:24.139451 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 131/263] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:24 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:12:24.217044 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-59e82eeb-b620-467f-8f9c-84eaf8be6546 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:24.218424 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-59e82eeb-b620-467f-8f9c-84eaf8be6546 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:24.227372 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-59e82eeb-b620-467f-8f9c-84eaf8be6546 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:24.227981 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-59e82eeb-b620-467f-8f9c-84eaf8be6546 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:24.228860 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-59e82eeb-b620-467f-8f9c-84eaf8be6546 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:24.229397 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-59e82eeb-b620-467f-8f9c-84eaf8be6546 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:24.307827 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-59e82eeb-b620-467f-8f9c-84eaf8be6546 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 14 microversion: 2.20 time: 0.094901 Nov 08 16:12:24.311160 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 133/264] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:24 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:24.946543 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b7c3d755-d375-4afd-b377-eb0170cb786d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:24.947229 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b7c3d755-d375-4afd-b377-eb0170cb786d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:24.954187 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b7c3d755-d375-4afd-b377-eb0170cb786d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:24.954632 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b7c3d755-d375-4afd-b377-eb0170cb786d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:24.955417 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b7c3d755-d375-4afd-b377-eb0170cb786d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:24.955823 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b7c3d755-d375-4afd-b377-eb0170cb786d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:25.152332 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a94643ab-b725-4d27-bad5-e3cf0b7120b5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:25.154654 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a94643ab-b725-4d27-bad5-e3cf0b7120b5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:25.179522 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a94643ab-b725-4d27-bad5-e3cf0b7120b5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:25.179984 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a94643ab-b725-4d27-bad5-e3cf0b7120b5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:25.180804 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a94643ab-b725-4d27-bad5-e3cf0b7120b5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:25.184100 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a94643ab-b725-4d27-bad5-e3cf0b7120b5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:25.222282 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b7c3d755-d375-4afd-b377-eb0170cb786d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:25.236454 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b7c3d755-d375-4afd-b377-eb0170cb786d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.294452 Nov 08 16:12:25.237091 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 132/265] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:24 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:25.263187 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a94643ab-b725-4d27-bad5-e3cf0b7120b5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 14 microversion: 2.1 time: 0.116887 Nov 08 16:12:25.264506 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 134/266] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:25 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 08 16:12:25.320529 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-611679ea-f59d-4e83-ad0f-73ac7c1c91bb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:25.321774 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-611679ea-f59d-4e83-ad0f-73ac7c1c91bb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:25.323110 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-695665389", "imageRef": "9abeafba-e602-4e0a-aab2-62160562de06", "flavorRef": "452", "networks": [{"uuid": "f70ee550-62a6-48db-bca5-a0b964bbcce9"}]}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:25.374494 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-611679ea-f59d-4e83-ad0f-73ac7c1c91bb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:25.374946 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-611679ea-f59d-4e83-ad0f-73ac7c1c91bb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:25.385075 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-611679ea-f59d-4e83-ad0f-73ac7c1c91bb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:25.386052 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-611679ea-f59d-4e83-ad0f-73ac7c1c91bb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:25.404369 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.network.neutron [None req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] validate_networks() for [('f70ee550-62a6-48db-bca5-a0b964bbcce9', None, None, None, None, None)] {{(pid=115524) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:12:25.507096 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-611679ea-f59d-4e83-ad0f-73ac7c1c91bb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 14 microversion: 2.20 time: 0.191453 Nov 08 16:12:25.508105 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 133/267] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:25 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:26.126984 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Flavor limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:12:26.127426 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Image limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:12:26.127904 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Flavor pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:12:26.128305 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Image pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:12:26.129118 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:12:26.138550 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:26.139238 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:26.140051 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:26.140483 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:26.158223 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Getting quotas for project 549e9715f7424ff5b3b252f354adafe9. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:12:26.164026 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Getting quotas for user fc7bdbcc6f4845d590103ec01173c2cb and project 549e9715f7424ff5b3b252f354adafe9. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:12:26.175095 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Going to run 1 instances... {{(pid=115524) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:12:26.177562 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9abeafba-e602-4e0a-aab2-62160562de06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:12:26.246751 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927159 Nov 08 16:12:26.272727 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f8781d69-c5ef-4249-971e-ef8183960962 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:26.273503 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f8781d69-c5ef-4249-971e-ef8183960962 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:26.284078 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 135/268] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Nov 8 16:12:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 16:12:26.289955 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f8781d69-c5ef-4249-971e-ef8183960962 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:26.290546 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f8781d69-c5ef-4249-971e-ef8183960962 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:26.296257 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-09876188-1504-4d0d-a941-0939975fd6e3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:26.296842 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f8781d69-c5ef-4249-971e-ef8183960962 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:26.297948 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f8781d69-c5ef-4249-971e-ef8183960962 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:26.298798 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-09876188-1504-4d0d-a941-0939975fd6e3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:26.309138 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-09876188-1504-4d0d-a941-0939975fd6e3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:26.309651 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-09876188-1504-4d0d-a941-0939975fd6e3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:26.310522 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-09876188-1504-4d0d-a941-0939975fd6e3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:26.311012 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-09876188-1504-4d0d-a941-0939975fd6e3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:26.399669 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-09876188-1504-4d0d-a941-0939975fd6e3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 14 microversion: 2.1 time: 0.114146 Nov 08 16:12:26.400313 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 136/269] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:26 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:12:26.405776 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-62453fec-69cd-4941-8e09-98224af7ff0f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:26.406482 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-62453fec-69cd-4941-8e09-98224af7ff0f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:26.508955 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-62453fec-69cd-4941-8e09-98224af7ff0f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:26.520767 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-62453fec-69cd-4941-8e09-98224af7ff0f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 200 len: 1217 microversion: 2.1 time: 0.118348 Nov 08 16:12:26.521725 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 137/270] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:26 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 1217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:26.529520 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-11bf86ce-b617-48cd-ae0f-04d62d406979 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:26.531070 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-11bf86ce-b617-48cd-ae0f-04d62d406979 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:26.539236 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-11bf86ce-b617-48cd-ae0f-04d62d406979 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:26.539980 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-11bf86ce-b617-48cd-ae0f-04d62d406979 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:26.540954 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-11bf86ce-b617-48cd-ae0f-04d62d406979 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:26.541625 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-11bf86ce-b617-48cd-ae0f-04d62d406979 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:26.575292 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f8781d69-c5ef-4249-971e-ef8183960962 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:26.586856 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f8781d69-c5ef-4249-971e-ef8183960962 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.322272 Nov 08 16:12:26.602620 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 134/271] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:26 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:26.638301 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-11bf86ce-b617-48cd-ae0f-04d62d406979 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 14 microversion: 2.20 time: 0.114419 Nov 08 16:12:26.642102 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 138/272] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:26 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:27.411594 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4f6904cb-7d30-48dd-a422-4a1bee2525e0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:27.413154 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4f6904cb-7d30-48dd-a422-4a1bee2525e0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:27.420825 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4f6904cb-7d30-48dd-a422-4a1bee2525e0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:27.421452 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4f6904cb-7d30-48dd-a422-4a1bee2525e0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:27.422403 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4f6904cb-7d30-48dd-a422-4a1bee2525e0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:27.422879 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4f6904cb-7d30-48dd-a422-4a1bee2525e0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:27.544491 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3cd551c8-0421-447e-86aa-a0e0efe513ec tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:27.544872 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3cd551c8-0421-447e-86aa-a0e0efe513ec tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:27.568250 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3cd551c8-0421-447e-86aa-a0e0efe513ec tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:27.569950 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3cd551c8-0421-447e-86aa-a0e0efe513ec tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:27.574854 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3cd551c8-0421-447e-86aa-a0e0efe513ec tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:27.575291 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3cd551c8-0421-447e-86aa-a0e0efe513ec tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:27.694061 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-3cd551c8-0421-447e-86aa-a0e0efe513ec tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:27.708653 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3cd551c8-0421-447e-86aa-a0e0efe513ec tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 200 len: 1269 microversion: 2.1 time: 0.173805 Nov 08 16:12:27.719160 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 139/273] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:27 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 1269 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:27.722226 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7a79b6a9-da23-4ee1-b18c-0a259b9d1b95 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:27.722842 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7a79b6a9-da23-4ee1-b18c-0a259b9d1b95 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:27.729520 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7a79b6a9-da23-4ee1-b18c-0a259b9d1b95 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:27.730242 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7a79b6a9-da23-4ee1-b18c-0a259b9d1b95 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:27.731231 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7a79b6a9-da23-4ee1-b18c-0a259b9d1b95 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:27.731956 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7a79b6a9-da23-4ee1-b18c-0a259b9d1b95 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:28.089516 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7a79b6a9-da23-4ee1-b18c-0a259b9d1b95 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:28.096890 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7a79b6a9-da23-4ee1-b18c-0a259b9d1b95 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.378485 Nov 08 16:12:28.097739 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 140/274] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:27 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:28.103086 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ea03b930-9b52-49ec-a8ee-13fe7752f97d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:28.104176 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ea03b930-9b52-49ec-a8ee-13fe7752f97d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:28.115179 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ea03b930-9b52-49ec-a8ee-13fe7752f97d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:28.115628 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ea03b930-9b52-49ec-a8ee-13fe7752f97d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:28.116452 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ea03b930-9b52-49ec-a8ee-13fe7752f97d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:28.116888 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ea03b930-9b52-49ec-a8ee-13fe7752f97d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:33.827204 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4f6904cb-7d30-48dd-a422-4a1bee2525e0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 14 microversion: 2.1 time: 6.418060 Nov 08 16:12:33.833746 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 135/275] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:27 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 14 bytes in 6427 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:12:33.835705 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ea03b930-9b52-49ec-a8ee-13fe7752f97d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 14 microversion: 2.20 time: 5.735832 Nov 08 16:12:33.839150 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 141/276] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:28 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 14 bytes in 5738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:33.840644 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ead42689-446a-4e7e-ab8b-4a091cde1f7b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:33.842104 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ead42689-446a-4e7e-ab8b-4a091cde1f7b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:33.842606 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e40734a6-63e1-4833-82f5-2b97f36c31ca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:33.843487 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e40734a6-63e1-4833-82f5-2b97f36c31ca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:33.860848 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e40734a6-63e1-4833-82f5-2b97f36c31ca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:33.865994 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e40734a6-63e1-4833-82f5-2b97f36c31ca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:33.867171 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e40734a6-63e1-4833-82f5-2b97f36c31ca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:33.867769 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e40734a6-63e1-4833-82f5-2b97f36c31ca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:33.879648 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ead42689-446a-4e7e-ab8b-4a091cde1f7b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:33.883092 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ead42689-446a-4e7e-ab8b-4a091cde1f7b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:33.888202 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ead42689-446a-4e7e-ab8b-4a091cde1f7b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:33.889126 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ead42689-446a-4e7e-ab8b-4a091cde1f7b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:34.069686 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ead42689-446a-4e7e-ab8b-4a091cde1f7b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:34.080997 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ead42689-446a-4e7e-ab8b-4a091cde1f7b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 200 len: 1269 microversion: 2.1 time: 0.245469 Nov 08 16:12:34.093279 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 136/277] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:33 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 1269 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:34.392128 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e40734a6-63e1-4833-82f5-2b97f36c31ca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:34.411156 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e40734a6-63e1-4833-82f5-2b97f36c31ca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.572566 Nov 08 16:12:34.414366 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 142/278] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:33 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:34.848493 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-82c0f1d1-3ddd-4fc3-9694-56719aa7bd15 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:34.849993 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a9f8518a-99e7-4068-b9c6-250f5e3694ef tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:34.851913 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a9f8518a-99e7-4068-b9c6-250f5e3694ef tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:34.852729 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-82c0f1d1-3ddd-4fc3-9694-56719aa7bd15 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:34.866244 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a9f8518a-99e7-4068-b9c6-250f5e3694ef tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:34.869930 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-82c0f1d1-3ddd-4fc3-9694-56719aa7bd15 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:34.877997 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-82c0f1d1-3ddd-4fc3-9694-56719aa7bd15 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:34.881971 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a9f8518a-99e7-4068-b9c6-250f5e3694ef tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:34.883287 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-82c0f1d1-3ddd-4fc3-9694-56719aa7bd15 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:34.887179 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a9f8518a-99e7-4068-b9c6-250f5e3694ef tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:34.887995 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-82c0f1d1-3ddd-4fc3-9694-56719aa7bd15 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:34.888698 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a9f8518a-99e7-4068-b9c6-250f5e3694ef tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:35.033182 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-82c0f1d1-3ddd-4fc3-9694-56719aa7bd15 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 14 microversion: 2.20 time: 0.189602 Nov 08 16:12:35.038128 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 143/279] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:34 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 14 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:35.038311 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a9f8518a-99e7-4068-b9c6-250f5e3694ef tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 14 microversion: 2.1 time: 0.199181 Nov 08 16:12:35.038311 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 137/280] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:34 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:12:35.100250 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-11f4ec4b-becd-466e-83f4-19a4e6cc4b68 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:35.100950 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-11f4ec4b-becd-466e-83f4-19a4e6cc4b68 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:35.129307 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-11f4ec4b-becd-466e-83f4-19a4e6cc4b68 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:35.130088 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-11f4ec4b-becd-466e-83f4-19a4e6cc4b68 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:35.133263 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-11f4ec4b-becd-466e-83f4-19a4e6cc4b68 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:35.134880 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-11f4ec4b-becd-466e-83f4-19a4e6cc4b68 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:35.379313 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9cdf0e6e-c335-4096-a945-5a67610cbffa tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Action: 'create', calling method: .version_select at 0x7f8c0c03c310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1157858539"}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:35.393789 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-9cdf0e6e-c335-4096-a945-5a67610cbffa tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Getting quotas for project 343d5ca096394f87bea0950aa3811a13. Resources: {'key_pairs'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:12:35.401911 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-11f4ec4b-becd-466e-83f4-19a4e6cc4b68 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:35.402412 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-9cdf0e6e-c335-4096-a945-5a67610cbffa tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Getting quotas for user e81a95f368744b3eb9fd85a9c6e0c8ed and project 343d5ca096394f87bea0950aa3811a13. Resources: {'key_pairs'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:12:35.415205 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-11f4ec4b-becd-466e-83f4-19a4e6cc4b68 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 200 len: 1275 microversion: 2.1 time: 0.319978 Nov 08 16:12:35.416581 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 144/281] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:35 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 1275 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:35.431323 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0f8283b7-51f9-4b04-b83b-5f7a4a3554c4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:35.432320 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0f8283b7-51f9-4b04-b83b-5f7a4a3554c4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:35.443708 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0f8283b7-51f9-4b04-b83b-5f7a4a3554c4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:35.445609 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0f8283b7-51f9-4b04-b83b-5f7a4a3554c4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:35.447226 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0f8283b7-51f9-4b04-b83b-5f7a4a3554c4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:35.450768 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0f8283b7-51f9-4b04-b83b-5f7a4a3554c4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:35.502736 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-9cdf0e6e-c335-4096-a945-5a67610cbffa tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Getting quotas for project 343d5ca096394f87bea0950aa3811a13. Resources: {'key_pairs'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:12:35.507610 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-9cdf0e6e-c335-4096-a945-5a67610cbffa tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Getting quotas for user e81a95f368744b3eb9fd85a9c6e0c8ed and project 343d5ca096394f87bea0950aa3811a13. Resources: {'key_pairs'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:12:35.525623 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-9cdf0e6e-c335-4096-a945-5a67610cbffa tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.454696 Nov 08 16:12:35.527169 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 138/282] 10.222.0.37 () {60 vars in 1157 bytes} [Mon Nov 8 16:12:35 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:35.802402 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0f8283b7-51f9-4b04-b83b-5f7a4a3554c4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:35.812187 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0f8283b7-51f9-4b04-b83b-5f7a4a3554c4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.384742 Nov 08 16:12:35.812874 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 145/283] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:35 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:36.052066 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-7c665bd8-3e9b-4b33-881e-90a4a48e15ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:36.054051 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-95c87c26-128a-4b99-b360-2c89140dd72a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:36.054489 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-7c665bd8-3e9b-4b33-881e-90a4a48e15ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:36.055867 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-95c87c26-128a-4b99-b360-2c89140dd72a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:36.064353 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-95c87c26-128a-4b99-b360-2c89140dd72a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:36.064793 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-95c87c26-128a-4b99-b360-2c89140dd72a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:36.065180 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7c665bd8-3e9b-4b33-881e-90a4a48e15ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:36.065632 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7c665bd8-3e9b-4b33-881e-90a4a48e15ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:36.066548 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7c665bd8-3e9b-4b33-881e-90a4a48e15ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:36.067143 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7c665bd8-3e9b-4b33-881e-90a4a48e15ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:36.068337 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-95c87c26-128a-4b99-b360-2c89140dd72a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:36.070169 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-95c87c26-128a-4b99-b360-2c89140dd72a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:36.139829 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-7c665bd8-3e9b-4b33-881e-90a4a48e15ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 14 microversion: 2.20 time: 0.091861 Nov 08 16:12:36.140520 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 139/284] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:36 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:36.148011 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c7c8cf30-e7be-4d64-b09f-d3b76917a848 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:36.148592 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c7c8cf30-e7be-4d64-b09f-d3b76917a848 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:36.168176 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c7c8cf30-e7be-4d64-b09f-d3b76917a848 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:36.168630 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c7c8cf30-e7be-4d64-b09f-d3b76917a848 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:36.170309 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c7c8cf30-e7be-4d64-b09f-d3b76917a848 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:36.170762 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c7c8cf30-e7be-4d64-b09f-d3b76917a848 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:36.221691 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c7c8cf30-e7be-4d64-b09f-d3b76917a848 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Going to try to terminate instance {{(pid=115523) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:12:36.289223 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-95c87c26-128a-4b99-b360-2c89140dd72a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 14 microversion: 2.1 time: 0.230340 Nov 08 16:12:36.290316 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 146/285] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:36 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 14 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 08 16:12:36.391223 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c7c8cf30-e7be-4d64-b09f-d3b76917a848 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "DELETE /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 204 len: 0 microversion: 2.1 time: 0.249064 Nov 08 16:12:36.391918 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 140/286] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:12:36 2021] DELETE /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:12:36.401104 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-955b2dbc-4b5c-4feb-b974-9b38c66eb261 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:36.402113 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-955b2dbc-4b5c-4feb-b974-9b38c66eb261 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:36.411923 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-955b2dbc-4b5c-4feb-b974-9b38c66eb261 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:36.412595 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-955b2dbc-4b5c-4feb-b974-9b38c66eb261 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:36.414322 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-955b2dbc-4b5c-4feb-b974-9b38c66eb261 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:36.415053 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-955b2dbc-4b5c-4feb-b974-9b38c66eb261 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:36.434536 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c10e6801-5278-4014-845b-c782fc2e2972 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:36.437206 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c10e6801-5278-4014-845b-c782fc2e2972 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:36.448133 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c10e6801-5278-4014-845b-c782fc2e2972 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:36.448857 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c10e6801-5278-4014-845b-c782fc2e2972 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:36.450079 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c10e6801-5278-4014-845b-c782fc2e2972 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:36.450710 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c10e6801-5278-4014-845b-c782fc2e2972 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:36.786747 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-955b2dbc-4b5c-4feb-b974-9b38c66eb261 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:36.797943 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-955b2dbc-4b5c-4feb-b974-9b38c66eb261 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1553 microversion: 2.1 time: 0.400971 Nov 08 16:12:36.798696 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 147/287] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:36 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1553 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:36.803299 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-6486a80b-209e-4a23-8f63-c27576ff5ed9 req-d38ec55b-e939-4982-89ef-5ada13471e35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "333fb179-0416-4534-95d0-4d9f3a9478f0", "tag": "d14efac8-b33a-4eb0-b610-32a9bf41b972"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:36.804978 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:12:36.804978 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:12:36.812603 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-6486a80b-209e-4a23-8f63-c27576ff5ed9 req-d38ec55b-e939-4982-89ef-5ada13471e35 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:36.813255 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-6486a80b-209e-4a23-8f63-c27576ff5ed9 req-d38ec55b-e939-4982-89ef-5ada13471e35 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:36.824967 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-6486a80b-209e-4a23-8f63-c27576ff5ed9 req-d38ec55b-e939-4982-89ef-5ada13471e35 service nova] Creating event network-changed:d14efac8-b33a-4eb0-b610-32a9bf41b972 for instance 333fb179-0416-4534-95d0-4d9f3a9478f0 on hv-cinder-81618 Nov 08 16:12:36.830442 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-6486a80b-209e-4a23-8f63-c27576ff5ed9 req-d38ec55b-e939-4982-89ef-5ada13471e35 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030446 Nov 08 16:12:36.831511 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 148/288] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:12:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:12:36.838145 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3a56e65b-5713-4927-bfb7-3eeb3516f2c8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:36.839061 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3a56e65b-5713-4927-bfb7-3eeb3516f2c8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:36.848217 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3a56e65b-5713-4927-bfb7-3eeb3516f2c8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:36.848858 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3a56e65b-5713-4927-bfb7-3eeb3516f2c8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:36.850408 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3a56e65b-5713-4927-bfb7-3eeb3516f2c8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:36.851004 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3a56e65b-5713-4927-bfb7-3eeb3516f2c8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:36.861018 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c10e6801-5278-4014-845b-c782fc2e2972 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:36.870023 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c10e6801-5278-4014-845b-c782fc2e2972 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 200 len: 1317 microversion: 2.1 time: 0.440181 Nov 08 16:12:36.884303 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 141/289] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:36 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:37.106553 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-3a56e65b-5713-4927-bfb7-3eeb3516f2c8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:37.114271 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3a56e65b-5713-4927-bfb7-3eeb3516f2c8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.280863 Nov 08 16:12:37.114832 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 149/290] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:36 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:37.151436 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3c1f87ee-5517-46e4-b2df-8a88fda1e97d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:37.152468 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3c1f87ee-5517-46e4-b2df-8a88fda1e97d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:37.169862 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3c1f87ee-5517-46e4-b2df-8a88fda1e97d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:37.170445 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3c1f87ee-5517-46e4-b2df-8a88fda1e97d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:37.171236 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3c1f87ee-5517-46e4-b2df-8a88fda1e97d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:37.171747 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3c1f87ee-5517-46e4-b2df-8a88fda1e97d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:37.301052 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-079f8442-f39f-401a-bda7-d6f4de4e660f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:37.302064 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-079f8442-f39f-401a-bda7-d6f4de4e660f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:37.310693 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-079f8442-f39f-401a-bda7-d6f4de4e660f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:37.311347 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-079f8442-f39f-401a-bda7-d6f4de4e660f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:37.313804 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-079f8442-f39f-401a-bda7-d6f4de4e660f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:37.314400 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-079f8442-f39f-401a-bda7-d6f4de4e660f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:37.397281 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3c1f87ee-5517-46e4-b2df-8a88fda1e97d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 4153 microversion: 2.20 time: 0.249406 Nov 08 16:12:37.402754 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 142/291] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:37 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 4153 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:12:37.618044 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-079f8442-f39f-401a-bda7-d6f4de4e660f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 6017 microversion: 2.1 time: 0.320722 Nov 08 16:12:37.621939 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 150/292] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:37 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 6017 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:37.817420 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f392af72-677a-4ff2-b464-000103ca14fb tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:37.819099 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f392af72-677a-4ff2-b464-000103ca14fb tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:37.831456 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f392af72-677a-4ff2-b464-000103ca14fb tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:37.858062 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f392af72-677a-4ff2-b464-000103ca14fb tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:37.861026 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f392af72-677a-4ff2-b464-000103ca14fb tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:37.862270 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f392af72-677a-4ff2-b464-000103ca14fb tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:37.893304 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a60fbf4d-861d-4c38-8870-354c744421df tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:37.894027 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a60fbf4d-861d-4c38-8870-354c744421df tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:37.914784 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a60fbf4d-861d-4c38-8870-354c744421df tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:37.915566 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a60fbf4d-861d-4c38-8870-354c744421df tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:37.916545 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a60fbf4d-861d-4c38-8870-354c744421df tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:37.917209 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a60fbf4d-861d-4c38-8870-354c744421df tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:38.435210 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f392af72-677a-4ff2-b464-000103ca14fb tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:38.442750 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a60fbf4d-861d-4c38-8870-354c744421df tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:38.462440 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a60fbf4d-861d-4c38-8870-354c744421df tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 200 len: 1317 microversion: 2.1 time: 0.572871 Nov 08 16:12:38.473935 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f392af72-677a-4ff2-b464-000103ca14fb tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1553 microversion: 2.1 time: 0.659576 Nov 08 16:12:38.485164 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 151/294] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:37 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 1317 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:38.485491 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 143/294] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:37 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1553 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:38.501320 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-acb09761-3069-49a6-b738-c07e2dc2ae6e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:38.502711 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-887aa3e7-3cf1-4d45-a598-48874a1e9ab0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:38.502892 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-acb09761-3069-49a6-b738-c07e2dc2ae6e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:38.503785 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-887aa3e7-3cf1-4d45-a598-48874a1e9ab0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:38.514146 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-887aa3e7-3cf1-4d45-a598-48874a1e9ab0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:38.515223 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-887aa3e7-3cf1-4d45-a598-48874a1e9ab0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:38.516872 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-887aa3e7-3cf1-4d45-a598-48874a1e9ab0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:38.517858 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-887aa3e7-3cf1-4d45-a598-48874a1e9ab0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:38.525062 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-acb09761-3069-49a6-b738-c07e2dc2ae6e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:38.525627 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-acb09761-3069-49a6-b738-c07e2dc2ae6e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:38.526888 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-acb09761-3069-49a6-b738-c07e2dc2ae6e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:38.532331 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-acb09761-3069-49a6-b738-c07e2dc2ae6e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:38.745041 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-acb09761-3069-49a6-b738-c07e2dc2ae6e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 7294 microversion: 2.20 time: 0.256425 Nov 08 16:12:38.746143 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 144/295] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:38 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 7294 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:12:38.751709 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-194e868b-a12f-42fe-9549-190d414d016a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:38.752990 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-194e868b-a12f-42fe-9549-190d414d016a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:38.760876 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-194e868b-a12f-42fe-9549-190d414d016a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:38.762749 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-194e868b-a12f-42fe-9549-190d414d016a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:38.763788 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-194e868b-a12f-42fe-9549-190d414d016a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:38.764225 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-194e868b-a12f-42fe-9549-190d414d016a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:38.951657 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-194e868b-a12f-42fe-9549-190d414d016a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 8073 microversion: 2.1 time: 0.203762 Nov 08 16:12:38.952250 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 145/296] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:38 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 8073 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:39.021359 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-887aa3e7-3cf1-4d45-a598-48874a1e9ab0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:39.034621 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-887aa3e7-3cf1-4d45-a598-48874a1e9ab0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.549513 Nov 08 16:12:39.035914 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 152/297] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:38 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:39.489003 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6616dd24-04e0-4bd6-a0a9-8e3424e6d2c0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:39.490445 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6616dd24-04e0-4bd6-a0a9-8e3424e6d2c0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:39.495613 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-767d33da-4ddf-4150-99f7-d956bcc463f5 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:39.496220 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-767d33da-4ddf-4150-99f7-d956bcc463f5 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:39.499079 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6616dd24-04e0-4bd6-a0a9-8e3424e6d2c0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:39.499760 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6616dd24-04e0-4bd6-a0a9-8e3424e6d2c0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:39.500752 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6616dd24-04e0-4bd6-a0a9-8e3424e6d2c0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:39.501663 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6616dd24-04e0-4bd6-a0a9-8e3424e6d2c0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:39.503544 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-767d33da-4ddf-4150-99f7-d956bcc463f5 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:39.506146 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-767d33da-4ddf-4150-99f7-d956bcc463f5 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:39.507278 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-767d33da-4ddf-4150-99f7-d956bcc463f5 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:39.508054 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-767d33da-4ddf-4150-99f7-d956bcc463f5 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:39.748932 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6616dd24-04e0-4bd6-a0a9-8e3424e6d2c0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:39.756494 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-767d33da-4ddf-4150-99f7-d956bcc463f5 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:39.757264 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6616dd24-04e0-4bd6-a0a9-8e3424e6d2c0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 200 len: 1317 microversion: 2.1 time: 0.272483 Nov 08 16:12:39.767487 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-767d33da-4ddf-4150-99f7-d956bcc463f5 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1553 microversion: 2.1 time: 0.275557 Nov 08 16:12:39.767620 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 146/298] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:39 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:39.768514 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 153/299] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:39 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1553 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:39.772813 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-04c94f23-c824-403f-a31e-abd661963d23 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:39.773760 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-04c94f23-c824-403f-a31e-abd661963d23 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:39.781965 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-04c94f23-c824-403f-a31e-abd661963d23 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:39.782692 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-04c94f23-c824-403f-a31e-abd661963d23 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:39.783701 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-04c94f23-c824-403f-a31e-abd661963d23 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:39.784964 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-04c94f23-c824-403f-a31e-abd661963d23 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:39.960760 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-04c94f23-c824-403f-a31e-abd661963d23 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 10367 microversion: 2.20 time: 0.191937 Nov 08 16:12:39.964229 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 147/300] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:39 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 10367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:12:39.964377 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7acc7611-1487-48b3-a795-0cb636113393 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:39.964377 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7acc7611-1487-48b3-a795-0cb636113393 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:39.970030 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7acc7611-1487-48b3-a795-0cb636113393 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:39.970478 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7acc7611-1487-48b3-a795-0cb636113393 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:39.971248 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7acc7611-1487-48b3-a795-0cb636113393 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:39.971671 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7acc7611-1487-48b3-a795-0cb636113393 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:40.053402 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-315f831b-bca2-49a6-be52-f418ad4b5602 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:40.054116 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-315f831b-bca2-49a6-be52-f418ad4b5602 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:40.061187 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-315f831b-bca2-49a6-be52-f418ad4b5602 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:40.061624 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-315f831b-bca2-49a6-be52-f418ad4b5602 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:40.062430 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-315f831b-bca2-49a6-be52-f418ad4b5602 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:40.062856 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-315f831b-bca2-49a6-be52-f418ad4b5602 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:40.209157 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-315f831b-bca2-49a6-be52-f418ad4b5602 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:40.221285 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-315f831b-bca2-49a6-be52-f418ad4b5602 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.172392 Nov 08 16:12:40.222172 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 148/301] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:40 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:40.227195 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7acc7611-1487-48b3-a795-0cb636113393 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 11207 microversion: 2.1 time: 0.267855 Nov 08 16:12:40.230865 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 154/302] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:39 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 11207 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:12:40.774978 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-42aaf829-6339-4082-ab1f-cc2d887dd2ea tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:40.775580 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-42aaf829-6339-4082-ab1f-cc2d887dd2ea tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:40.786452 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d7311ffa-77b1-4356-a2a9-9bd517c7c6c8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:40.787145 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d7311ffa-77b1-4356-a2a9-9bd517c7c6c8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:40.787301 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-42aaf829-6339-4082-ab1f-cc2d887dd2ea tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:40.787599 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-42aaf829-6339-4082-ab1f-cc2d887dd2ea tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:40.788655 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-42aaf829-6339-4082-ab1f-cc2d887dd2ea tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:40.789111 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-42aaf829-6339-4082-ab1f-cc2d887dd2ea tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:40.794882 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d7311ffa-77b1-4356-a2a9-9bd517c7c6c8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:40.795610 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d7311ffa-77b1-4356-a2a9-9bd517c7c6c8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:40.796418 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d7311ffa-77b1-4356-a2a9-9bd517c7c6c8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:40.796858 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d7311ffa-77b1-4356-a2a9-9bd517c7c6c8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:41.133690 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-42aaf829-6339-4082-ab1f-cc2d887dd2ea tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:41.143328 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-42aaf829-6339-4082-ab1f-cc2d887dd2ea tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 200 len: 1317 microversion: 2.1 time: 0.371852 Nov 08 16:12:41.145161 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 149/303] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:40 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:41.161336 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-eaf9d8f3-9164-453e-a8b4-5d58738ac6d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:41.163931 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-eaf9d8f3-9164-453e-a8b4-5d58738ac6d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:41.172040 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eaf9d8f3-9164-453e-a8b4-5d58738ac6d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:41.172669 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eaf9d8f3-9164-453e-a8b4-5d58738ac6d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:41.173644 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eaf9d8f3-9164-453e-a8b4-5d58738ac6d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:41.174365 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eaf9d8f3-9164-453e-a8b4-5d58738ac6d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:41.178435 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-d7311ffa-77b1-4356-a2a9-9bd517c7c6c8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:41.188880 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d7311ffa-77b1-4356-a2a9-9bd517c7c6c8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1553 microversion: 2.1 time: 0.406567 Nov 08 16:12:41.199465 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 155/304] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:40 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1553 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:41.238584 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4104fb82-8524-4b83-b0c5-05f7fbe848f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:41.239467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4104fb82-8524-4b83-b0c5-05f7fbe848f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:41.245394 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4104fb82-8524-4b83-b0c5-05f7fbe848f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:41.246095 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4104fb82-8524-4b83-b0c5-05f7fbe848f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:41.247051 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4104fb82-8524-4b83-b0c5-05f7fbe848f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:41.247639 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4104fb82-8524-4b83-b0c5-05f7fbe848f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:41.292962 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-eaf9d8f3-9164-453e-a8b4-5d58738ac6d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 13243 microversion: 2.20 time: 0.146311 Nov 08 16:12:41.293605 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 150/305] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:41 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 13243 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:12:41.298694 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-61ec67a7-862d-4325-8d66-c9c90b257f53 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:41.299798 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-61ec67a7-862d-4325-8d66-c9c90b257f53 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:41.311360 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-61ec67a7-862d-4325-8d66-c9c90b257f53 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:41.311548 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-61ec67a7-862d-4325-8d66-c9c90b257f53 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:41.312391 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-61ec67a7-862d-4325-8d66-c9c90b257f53 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:41.312842 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-61ec67a7-862d-4325-8d66-c9c90b257f53 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:41.433555 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-61ec67a7-862d-4325-8d66-c9c90b257f53 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 13651 microversion: 2.1 time: 0.138202 Nov 08 16:12:41.434442 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 151/306] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:41 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 13651 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:12:41.480261 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-9431f336-d2fa-40c9-86c0-a4d3285f744b req-29e3e6d2-4b7f-4361-a6a3-87927bb6ad0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec4f96b9-4128-4da6-9880-95a0f72fd4e2", "name": "network-vif-deleted", "tag": "70c72d16-a0e9-49bb-b7b8-ef436d81a390"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:41.483579 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:12:41.483579 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:12:41.507847 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-9431f336-d2fa-40c9-86c0-a4d3285f744b req-29e3e6d2-4b7f-4361-a6a3-87927bb6ad0f service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:41.511147 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-9431f336-d2fa-40c9-86c0-a4d3285f744b req-29e3e6d2-4b7f-4361-a6a3-87927bb6ad0f service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:41.517093 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4104fb82-8524-4b83-b0c5-05f7fbe848f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:41.529810 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4104fb82-8524-4b83-b0c5-05f7fbe848f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.295018 Nov 08 16:12:41.530619 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-9431f336-d2fa-40c9-86c0-a4d3285f744b req-29e3e6d2-4b7f-4361-a6a3-87927bb6ad0f service nova] Creating event network-vif-deleted:70c72d16-a0e9-49bb-b7b8-ef436d81a390 for instance ec4f96b9-4128-4da6-9880-95a0f72fd4e2 on hv-cinder-81618 Nov 08 16:12:41.535903 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-9431f336-d2fa-40c9-86c0-a4d3285f744b req-29e3e6d2-4b7f-4361-a6a3-87927bb6ad0f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063481 Nov 08 16:12:41.537001 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 152/307] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:12:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:12:41.540837 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 156/308] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:41 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:42.161574 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8cf70a6c-dcc5-433b-9078-38a3787cead9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:42.162345 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8cf70a6c-dcc5-433b-9078-38a3787cead9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:42.168998 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8cf70a6c-dcc5-433b-9078-38a3787cead9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:42.169440 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8cf70a6c-dcc5-433b-9078-38a3787cead9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:42.170253 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8cf70a6c-dcc5-433b-9078-38a3787cead9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:42.170687 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8cf70a6c-dcc5-433b-9078-38a3787cead9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:42.207195 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4a63defe-138e-4b75-ade8-e1116a00ef4c tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:42.207828 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4a63defe-138e-4b75-ade8-e1116a00ef4c tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:42.214998 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a63defe-138e-4b75-ade8-e1116a00ef4c tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:42.216761 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a63defe-138e-4b75-ade8-e1116a00ef4c tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:42.217856 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a63defe-138e-4b75-ade8-e1116a00ef4c tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:42.218539 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a63defe-138e-4b75-ade8-e1116a00ef4c tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:42.286215 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a63defe-138e-4b75-ade8-e1116a00ef4c tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:42.287191 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a63defe-138e-4b75-ade8-e1116a00ef4c tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:42.288476 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.objects.instance [None req-4a63defe-138e-4b75-ade8-e1116a00ef4c tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lazy-loading 'fault' on Instance uuid ec4f96b9-4128-4da6-9880-95a0f72fd4e2 {{(pid=115524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:12:42.348461 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4a63defe-138e-4b75-ade8-e1116a00ef4c tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718d3c695a2f45aa8ac4c6c01d28265b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170b9e4079834c589534d39e70e1dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:42.357080 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4a63defe-138e-4b75-ade8-e1116a00ef4c tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 200 len: 1350 microversion: 2.1 time: 0.154314 Nov 08 16:12:42.358766 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 157/309] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:42 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 1350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:42.363239 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d6372e46-720b-46f9-9d7b-a14b587c8b23 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:42.364345 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d6372e46-720b-46f9-9d7b-a14b587c8b23 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:42.370479 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d6372e46-720b-46f9-9d7b-a14b587c8b23 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:42.371153 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d6372e46-720b-46f9-9d7b-a14b587c8b23 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:42.372100 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d6372e46-720b-46f9-9d7b-a14b587c8b23 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:42.372541 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d6372e46-720b-46f9-9d7b-a14b587c8b23 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:42.492682 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d6372e46-720b-46f9-9d7b-a14b587c8b23 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 15064 microversion: 2.20 time: 0.132961 Nov 08 16:12:42.496282 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 158/310] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:42 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 15064 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:12:42.499674 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f8dfc817-6ed0-4248-b3c2-c829de18a37d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:42.500604 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f8dfc817-6ed0-4248-b3c2-c829de18a37d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:42.510846 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8cf70a6c-dcc5-433b-9078-38a3787cead9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:42.513228 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8dfc817-6ed0-4248-b3c2-c829de18a37d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:42.513689 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8dfc817-6ed0-4248-b3c2-c829de18a37d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:42.514684 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8dfc817-6ed0-4248-b3c2-c829de18a37d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:42.515129 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8dfc817-6ed0-4248-b3c2-c829de18a37d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:42.523736 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8cf70a6c-dcc5-433b-9078-38a3787cead9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 200 len: 1317 microversion: 2.1 time: 0.366171 Nov 08 16:12:42.525008 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 153/311] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:42 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:42.546598 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e88a5ec4-843a-4365-812a-4396b031eeab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:42.547545 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e88a5ec4-843a-4365-812a-4396b031eeab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:42.571081 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e88a5ec4-843a-4365-812a-4396b031eeab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:42.572160 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e88a5ec4-843a-4365-812a-4396b031eeab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:42.573180 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e88a5ec4-843a-4365-812a-4396b031eeab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:42.573856 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e88a5ec4-843a-4365-812a-4396b031eeab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:42.641426 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f8dfc817-6ed0-4248-b3c2-c829de18a37d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 15064 microversion: 2.1 time: 0.146020 Nov 08 16:12:42.642102 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 159/312] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:42 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 15064 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:12:42.743641 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-e88a5ec4-843a-4365-812a-4396b031eeab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:42.756107 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e88a5ec4-843a-4365-812a-4396b031eeab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.213051 Nov 08 16:12:42.756740 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 154/313] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:42 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:43.374715 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-777daefd-08c2-45c8-b27b-95fc0569324b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:43.375308 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-777daefd-08c2-45c8-b27b-95fc0569324b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:43.382169 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-777daefd-08c2-45c8-b27b-95fc0569324b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:43.382610 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-777daefd-08c2-45c8-b27b-95fc0569324b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:43.383367 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-777daefd-08c2-45c8-b27b-95fc0569324b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:43.383790 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-777daefd-08c2-45c8-b27b-95fc0569324b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:43.396993 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-777daefd-08c2-45c8-b27b-95fc0569324b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] HTTP exception thrown: Instance ec4f96b9-4128-4da6-9880-95a0f72fd4e2 could not be found. Nov 08 16:12:43.397567 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-777daefd-08c2-45c8-b27b-95fc0569324b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Returning 404 to user: Instance ec4f96b9-4128-4da6-9880-95a0f72fd4e2 could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:12:43.398408 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-777daefd-08c2-45c8-b27b-95fc0569324b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 404 len: 111 microversion: 2.1 time: 0.028113 Nov 08 16:12:43.399183 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 160/314] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:43 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 08 16:12:43.496776 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3d62f9b1-38d6-4f28-8e1d-145295c29d44 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:43.497689 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3d62f9b1-38d6-4f28-8e1d-145295c29d44 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:43.504121 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d9fe649d-f82f-462f-b592-3e32bbfaadd0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:43.504267 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3d62f9b1-38d6-4f28-8e1d-145295c29d44 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:43.504697 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3d62f9b1-38d6-4f28-8e1d-145295c29d44 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:43.505038 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d9fe649d-f82f-462f-b592-3e32bbfaadd0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:43.505466 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3d62f9b1-38d6-4f28-8e1d-145295c29d44 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:43.505937 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3d62f9b1-38d6-4f28-8e1d-145295c29d44 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:43.511275 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d9fe649d-f82f-462f-b592-3e32bbfaadd0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:43.511714 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d9fe649d-f82f-462f-b592-3e32bbfaadd0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:43.512477 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d9fe649d-f82f-462f-b592-3e32bbfaadd0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:43.512905 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d9fe649d-f82f-462f-b592-3e32bbfaadd0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:43.518200 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-3d62f9b1-38d6-4f28-8e1d-145295c29d44 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] HTTP exception thrown: Instance ec4f96b9-4128-4da6-9880-95a0f72fd4e2 could not be found. Nov 08 16:12:43.518783 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3d62f9b1-38d6-4f28-8e1d-145295c29d44 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Returning 404 to user: Instance ec4f96b9-4128-4da6-9880-95a0f72fd4e2 could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:12:43.519599 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3d62f9b1-38d6-4f28-8e1d-145295c29d44 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.026616 Nov 08 16:12:43.520122 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 155/315] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:12:43 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2/os-volume_attachments => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:12:43.540543 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-85fefeee-d2d0-4b38-aba5-cf4317247f8b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:43.541136 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-85fefeee-d2d0-4b38-aba5-cf4317247f8b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:43.548505 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-85fefeee-d2d0-4b38-aba5-cf4317247f8b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:43.549433 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-85fefeee-d2d0-4b38-aba5-cf4317247f8b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:43.549926 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-85fefeee-d2d0-4b38-aba5-cf4317247f8b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:43.550358 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-85fefeee-d2d0-4b38-aba5-cf4317247f8b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:43.695951 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-85fefeee-d2d0-4b38-aba5-cf4317247f8b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:43.701445 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d9fe649d-f82f-462f-b592-3e32bbfaadd0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 17808 microversion: 2.20 time: 0.200841 Nov 08 16:12:43.702155 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 161/316] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:43 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 17808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:12:43.703653 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-85fefeee-d2d0-4b38-aba5-cf4317247f8b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 200 len: 1317 microversion: 2.1 time: 0.167318 Nov 08 16:12:43.706076 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 156/317] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:43 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:43.707938 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-6892844b-1aee-451d-80fd-52aa23b6c4b7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:43.708928 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-6892844b-1aee-451d-80fd-52aa23b6c4b7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:43.716544 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6892844b-1aee-451d-80fd-52aa23b6c4b7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:43.716994 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6892844b-1aee-451d-80fd-52aa23b6c4b7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:43.717807 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6892844b-1aee-451d-80fd-52aa23b6c4b7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:43.718272 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6892844b-1aee-451d-80fd-52aa23b6c4b7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:43.772920 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-fa9bf2ea-5c0a-4b17-9193-b06b8cb0983d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:43.773518 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fa9bf2ea-5c0a-4b17-9193-b06b8cb0983d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:43.779294 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fa9bf2ea-5c0a-4b17-9193-b06b8cb0983d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:43.779734 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fa9bf2ea-5c0a-4b17-9193-b06b8cb0983d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:43.780493 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fa9bf2ea-5c0a-4b17-9193-b06b8cb0983d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:43.780918 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fa9bf2ea-5c0a-4b17-9193-b06b8cb0983d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:43.826645 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-6892844b-1aee-451d-80fd-52aa23b6c4b7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 17602 microversion: 2.1 time: 0.122371 Nov 08 16:12:43.827296 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 162/318] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:43 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 17602 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:12:43.919874 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fa9bf2ea-5c0a-4b17-9193-b06b8cb0983d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:43.929135 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-fa9bf2ea-5c0a-4b17-9193-b06b8cb0983d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.160242 Nov 08 16:12:43.932714 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 157/319] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:43 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:44.717772 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ce9aa7af-04f2-4ae4-a50f-16c2fbd8c44a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:44.717772 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ce9aa7af-04f2-4ae4-a50f-16c2fbd8c44a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:44.719955 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6b936d44-ec19-4caf-a723-a57e4edd9b2a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:44.720450 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6b936d44-ec19-4caf-a723-a57e4edd9b2a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:44.726104 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ce9aa7af-04f2-4ae4-a50f-16c2fbd8c44a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:44.726578 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6b936d44-ec19-4caf-a723-a57e4edd9b2a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:44.726693 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ce9aa7af-04f2-4ae4-a50f-16c2fbd8c44a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:44.727023 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6b936d44-ec19-4caf-a723-a57e4edd9b2a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:44.727720 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ce9aa7af-04f2-4ae4-a50f-16c2fbd8c44a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:44.727878 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6b936d44-ec19-4caf-a723-a57e4edd9b2a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:44.728246 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6b936d44-ec19-4caf-a723-a57e4edd9b2a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:44.728379 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ce9aa7af-04f2-4ae4-a50f-16c2fbd8c44a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:44.742113 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-6b936d44-ec19-4caf-a723-a57e4edd9b2a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] HTTP exception thrown: Instance ec4f96b9-4128-4da6-9880-95a0f72fd4e2 could not be found. Nov 08 16:12:44.742698 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6b936d44-ec19-4caf-a723-a57e4edd9b2a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Returning 404 to user: Instance ec4f96b9-4128-4da6-9880-95a0f72fd4e2 could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:12:44.743537 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6b936d44-ec19-4caf-a723-a57e4edd9b2a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "DELETE /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 404 len: 111 microversion: 2.1 time: 0.027301 Nov 08 16:12:44.744075 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 158/320] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:12:44 2021] DELETE /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:12:44.748528 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c91e3f20-ad2a-4259-b875-1dadc260f42d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:44.749114 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c91e3f20-ad2a-4259-b875-1dadc260f42d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:44.754666 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c91e3f20-ad2a-4259-b875-1dadc260f42d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:44.755101 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c91e3f20-ad2a-4259-b875-1dadc260f42d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:44.756683 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c91e3f20-ad2a-4259-b875-1dadc260f42d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:44.757130 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c91e3f20-ad2a-4259-b875-1dadc260f42d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:44.808901 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ce9aa7af-04f2-4ae4-a50f-16c2fbd8c44a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 17960 microversion: 2.20 time: 0.099903 Nov 08 16:12:44.812702 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 163/321] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:44 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 17960 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:12:44.815998 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-81f2576b-3989-4ca5-bec1-c07f09f2738e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:44.816800 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-81f2576b-3989-4ca5-bec1-c07f09f2738e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] [instance: ec4f96b9-4128-4da6-9880-95a0f72fd4e2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:44.824843 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-81f2576b-3989-4ca5-bec1-c07f09f2738e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:44.825291 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-81f2576b-3989-4ca5-bec1-c07f09f2738e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:44.826108 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-81f2576b-3989-4ca5-bec1-c07f09f2738e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:44.826540 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-81f2576b-3989-4ca5-bec1-c07f09f2738e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:44.841402 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-81f2576b-3989-4ca5-bec1-c07f09f2738e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] HTTP exception thrown: Instance ec4f96b9-4128-4da6-9880-95a0f72fd4e2 could not be found. Nov 08 16:12:44.842137 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-81f2576b-3989-4ca5-bec1-c07f09f2738e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Returning 404 to user: Instance ec4f96b9-4128-4da6-9880-95a0f72fd4e2 could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:12:44.842971 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-81f2576b-3989-4ca5-bec1-c07f09f2738e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2" status: 404 len: 111 microversion: 2.1 time: 0.032289 Nov 08 16:12:44.843510 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 164/322] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:44 2021] GET /compute/v2.1/servers/ec4f96b9-4128-4da6-9880-95a0f72fd4e2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:12:44.848739 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-670b0e4e-73ed-4c16-8c24-870096d928de tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:44.849663 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-670b0e4e-73ed-4c16-8c24-870096d928de tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:44.856357 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-670b0e4e-73ed-4c16-8c24-870096d928de tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:44.856922 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-670b0e4e-73ed-4c16-8c24-870096d928de tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:44.857689 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-670b0e4e-73ed-4c16-8c24-870096d928de tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:44.858211 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-670b0e4e-73ed-4c16-8c24-870096d928de tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:44.902011 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c91e3f20-ad2a-4259-b875-1dadc260f42d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:44.910237 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c91e3f20-ad2a-4259-b875-1dadc260f42d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 200 len: 1317 microversion: 2.1 time: 0.165212 Nov 08 16:12:44.911134 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 159/323] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:44 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:44.940631 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-670b0e4e-73ed-4c16-8c24-870096d928de tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 17602 microversion: 2.1 time: 0.095067 Nov 08 16:12:44.941929 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 165/324] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:44 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 17602 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:12:44.948857 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-52f348ad-6906-4b41-bc40-5ee4b8cb018e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:44.949567 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-52f348ad-6906-4b41-bc40-5ee4b8cb018e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:44.955880 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-52f348ad-6906-4b41-bc40-5ee4b8cb018e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:44.956409 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-52f348ad-6906-4b41-bc40-5ee4b8cb018e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:44.957465 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-52f348ad-6906-4b41-bc40-5ee4b8cb018e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:44.966106 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-52f348ad-6906-4b41-bc40-5ee4b8cb018e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:45.153370 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-52f348ad-6906-4b41-bc40-5ee4b8cb018e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:45.162001 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-52f348ad-6906-4b41-bc40-5ee4b8cb018e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.217868 Nov 08 16:12:45.162564 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 160/325] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:44 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:45.713627 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-539b0dd6-4b3b-4964-ac28-8a67f9fb0e49 req-fa00c635-a054-4fd0-9b42-24334417d351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "333fb179-0416-4534-95d0-4d9f3a9478f0", "name": "network-vif-plugged", "status": "completed", "tag": "d14efac8-b33a-4eb0-b610-32a9bf41b972"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:45.715554 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:12:45.715554 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:12:45.732913 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-539b0dd6-4b3b-4964-ac28-8a67f9fb0e49 req-fa00c635-a054-4fd0-9b42-24334417d351 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:45.734471 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-539b0dd6-4b3b-4964-ac28-8a67f9fb0e49 req-fa00c635-a054-4fd0-9b42-24334417d351 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:45.758984 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-539b0dd6-4b3b-4964-ac28-8a67f9fb0e49 req-fa00c635-a054-4fd0-9b42-24334417d351 service nova] Creating event network-vif-plugged:d14efac8-b33a-4eb0-b610-32a9bf41b972 for instance 333fb179-0416-4534-95d0-4d9f3a9478f0 on hv-cinder-81618 Nov 08 16:12:45.764477 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-539b0dd6-4b3b-4964-ac28-8a67f9fb0e49 req-fa00c635-a054-4fd0-9b42-24334417d351 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061221 Nov 08 16:12:45.765541 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 166/326] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:12:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:12:45.820878 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f204353b-0b7f-4254-ae20-053f3b393b13 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:45.821824 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f204353b-0b7f-4254-ae20-053f3b393b13 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:45.828234 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f204353b-0b7f-4254-ae20-053f3b393b13 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:45.828672 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f204353b-0b7f-4254-ae20-053f3b393b13 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:45.829581 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f204353b-0b7f-4254-ae20-053f3b393b13 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:45.830044 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f204353b-0b7f-4254-ae20-053f3b393b13 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:45.928359 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-8be2bcbb-0347-4055-a718-f35e343426fd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:45.928836 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-8be2bcbb-0347-4055-a718-f35e343426fd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:45.936968 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8be2bcbb-0347-4055-a718-f35e343426fd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:45.937804 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8be2bcbb-0347-4055-a718-f35e343426fd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:45.938882 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8be2bcbb-0347-4055-a718-f35e343426fd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:45.939437 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8be2bcbb-0347-4055-a718-f35e343426fd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:45.941629 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f204353b-0b7f-4254-ae20-053f3b393b13 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 19601 microversion: 2.20 time: 0.124696 Nov 08 16:12:45.947819 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 161/327] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:45 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 19601 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:12:45.963135 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-00455521-f946-4119-81af-58955ab0e371 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:45.964735 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-00455521-f946-4119-81af-58955ab0e371 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:45.975668 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-00455521-f946-4119-81af-58955ab0e371 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:45.976122 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-00455521-f946-4119-81af-58955ab0e371 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:45.977464 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-00455521-f946-4119-81af-58955ab0e371 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:45.978082 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-00455521-f946-4119-81af-58955ab0e371 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:46.074099 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-00455521-f946-4119-81af-58955ab0e371 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 19508 microversion: 2.1 time: 0.122078 Nov 08 16:12:46.074743 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 162/328] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:45 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 19508 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:12:46.157964 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-8be2bcbb-0347-4055-a718-f35e343426fd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:46.165407 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-8be2bcbb-0347-4055-a718-f35e343426fd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 200 len: 1317 microversion: 2.1 time: 0.241791 Nov 08 16:12:46.166084 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 167/329] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:45 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:46.181930 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c526675b-2753-447f-bbad-be5546606f14 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:46.182625 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c526675b-2753-447f-bbad-be5546606f14 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:46.189574 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c526675b-2753-447f-bbad-be5546606f14 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:46.190277 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c526675b-2753-447f-bbad-be5546606f14 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:46.191339 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c526675b-2753-447f-bbad-be5546606f14 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:46.191854 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c526675b-2753-447f-bbad-be5546606f14 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:46.327030 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c526675b-2753-447f-bbad-be5546606f14 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:46.334654 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c526675b-2753-447f-bbad-be5546606f14 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.159684 Nov 08 16:12:46.335236 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 163/330] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:46 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:46.953128 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-31c5f230-6318-4966-a0a8-4815dda82216 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:46.954136 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-31c5f230-6318-4966-a0a8-4815dda82216 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:46.961310 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-31c5f230-6318-4966-a0a8-4815dda82216 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:46.961789 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-31c5f230-6318-4966-a0a8-4815dda82216 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:46.962567 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-31c5f230-6318-4966-a0a8-4815dda82216 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:46.963058 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-31c5f230-6318-4966-a0a8-4815dda82216 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:47.086641 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-47513941-ee71-4f9f-8cc8-cc36cca54998 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:47.087343 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-47513941-ee71-4f9f-8cc8-cc36cca54998 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:47.093196 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-47513941-ee71-4f9f-8cc8-cc36cca54998 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:47.093632 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-47513941-ee71-4f9f-8cc8-cc36cca54998 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:47.094457 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-47513941-ee71-4f9f-8cc8-cc36cca54998 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:47.094879 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-47513941-ee71-4f9f-8cc8-cc36cca54998 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:47.271852 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-47513941-ee71-4f9f-8cc8-cc36cca54998 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 21928 microversion: 2.1 time: 0.190023 Nov 08 16:12:47.275658 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 164/331] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:47 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 21928 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:12:47.277541 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a0435e99-4e3f-4364-b6f0-8684fad68808 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:47.278238 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a0435e99-4e3f-4364-b6f0-8684fad68808 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:47.285376 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a0435e99-4e3f-4364-b6f0-8684fad68808 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:47.285861 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a0435e99-4e3f-4364-b6f0-8684fad68808 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:47.286699 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a0435e99-4e3f-4364-b6f0-8684fad68808 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:47.287286 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a0435e99-4e3f-4364-b6f0-8684fad68808 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:47.290933 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-31c5f230-6318-4966-a0a8-4815dda82216 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 21928 microversion: 2.20 time: 0.342223 Nov 08 16:12:47.292582 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 168/332] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:46 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 21928 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:12:47.352249 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-27d9cfe2-fc9f-4340-a389-9cdb6647ff44 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:47.353076 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-27d9cfe2-fc9f-4340-a389-9cdb6647ff44 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:47.360078 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-27d9cfe2-fc9f-4340-a389-9cdb6647ff44 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:47.360526 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-27d9cfe2-fc9f-4340-a389-9cdb6647ff44 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:47.361300 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-27d9cfe2-fc9f-4340-a389-9cdb6647ff44 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:47.362005 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-27d9cfe2-fc9f-4340-a389-9cdb6647ff44 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:47.471487 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a0435e99-4e3f-4364-b6f0-8684fad68808 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:47.480143 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a0435e99-4e3f-4364-b6f0-8684fad68808 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 200 len: 1317 microversion: 2.1 time: 0.206269 Nov 08 16:12:47.480717 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 165/333] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:47 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:47.534617 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-27d9cfe2-fc9f-4340-a389-9cdb6647ff44 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:47.547276 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-27d9cfe2-fc9f-4340-a389-9cdb6647ff44 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.199049 Nov 08 16:12:47.548026 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 169/334] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:47 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:48.283433 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6538b5bc-845c-4dd6-8d3d-71206f918c70 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:48.284762 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6538b5bc-845c-4dd6-8d3d-71206f918c70 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:48.292964 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6538b5bc-845c-4dd6-8d3d-71206f918c70 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:48.293507 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6538b5bc-845c-4dd6-8d3d-71206f918c70 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:48.294437 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6538b5bc-845c-4dd6-8d3d-71206f918c70 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:48.294957 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6538b5bc-845c-4dd6-8d3d-71206f918c70 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:48.302344 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-27fc0161-d0b0-4a4d-ae72-f5c26b798fc8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:48.303823 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-27fc0161-d0b0-4a4d-ae72-f5c26b798fc8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:48.312975 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-27fc0161-d0b0-4a4d-ae72-f5c26b798fc8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:48.313728 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-27fc0161-d0b0-4a4d-ae72-f5c26b798fc8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:48.314888 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-27fc0161-d0b0-4a4d-ae72-f5c26b798fc8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:48.315539 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-27fc0161-d0b0-4a4d-ae72-f5c26b798fc8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:48.449205 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6538b5bc-845c-4dd6-8d3d-71206f918c70 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 23020 microversion: 2.1 time: 0.169801 Nov 08 16:12:48.450169 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 166/335] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:48 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 23020 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:12:48.487565 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-27fc0161-d0b0-4a4d-ae72-f5c26b798fc8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 22973 microversion: 2.20 time: 0.188629 Nov 08 16:12:48.488462 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 170/336] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:48 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 22973 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:12:48.498057 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a075eb10-1b86-4f5b-be5a-4b28ccce3546 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:48.499267 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a075eb10-1b86-4f5b-be5a-4b28ccce3546 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:48.505445 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a075eb10-1b86-4f5b-be5a-4b28ccce3546 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:48.505914 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a075eb10-1b86-4f5b-be5a-4b28ccce3546 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:48.506682 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a075eb10-1b86-4f5b-be5a-4b28ccce3546 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:48.507109 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a075eb10-1b86-4f5b-be5a-4b28ccce3546 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:48.565353 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-cfa753e7-57a4-4c2e-b9c6-654cd19bc2c4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:48.566275 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-cfa753e7-57a4-4c2e-b9c6-654cd19bc2c4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:48.573958 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cfa753e7-57a4-4c2e-b9c6-654cd19bc2c4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:48.574415 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cfa753e7-57a4-4c2e-b9c6-654cd19bc2c4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:48.575254 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cfa753e7-57a4-4c2e-b9c6-654cd19bc2c4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:48.575843 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cfa753e7-57a4-4c2e-b9c6-654cd19bc2c4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:48.682206 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a075eb10-1b86-4f5b-be5a-4b28ccce3546 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:48.695563 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a075eb10-1b86-4f5b-be5a-4b28ccce3546 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 200 len: 1507 microversion: 2.1 time: 0.201645 Nov 08 16:12:48.696481 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 167/337] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:48 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:48.754388 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-cfa753e7-57a4-4c2e-b9c6-654cd19bc2c4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:48.757094 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-064bc558-9c56-45ee-b1e0-b17359a6f342 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0345609c-84ca-4607-b487-e6cb821e3dac"}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:48.759899 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-064bc558-9c56-45ee-b1e0-b17359a6f342 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:48.765275 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-cfa753e7-57a4-4c2e-b9c6-654cd19bc2c4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.204566 Nov 08 16:12:48.765950 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 171/338] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:48 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:48.766846 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-064bc558-9c56-45ee-b1e0-b17359a6f342 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:48.767291 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-064bc558-9c56-45ee-b1e0-b17359a6f342 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:48.768074 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-064bc558-9c56-45ee-b1e0-b17359a6f342 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:48.768499 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-064bc558-9c56-45ee-b1e0-b17359a6f342 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:48.855070 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-064bc558-9c56-45ee-b1e0-b17359a6f342 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] HTTP exception thrown: Invalid volume: volume 0345609c-84ca-4607-b487-e6cb821e3dac is already attached to instances: dfa35d29-db7d-4fab-a001-7db0d508d70a Nov 08 16:12:48.855912 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-064bc558-9c56-45ee-b1e0-b17359a6f342 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Returning 400 to user: Invalid volume: volume 0345609c-84ca-4607-b487-e6cb821e3dac is already attached to instances: dfa35d29-db7d-4fab-a001-7db0d508d70a {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:12:48.857048 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-064bc558-9c56-45ee-b1e0-b17359a6f342 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "POST /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109384 Nov 08 16:12:48.857961 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 168/339] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Nov 8 16:12:48 2021] POST /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 08 16:12:48.922604 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f0fec21f-630b-4cf3-ba80-e2ed70b7cf81 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:48.923150 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f0fec21f-630b-4cf3-ba80-e2ed70b7cf81 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:48.929079 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f0fec21f-630b-4cf3-ba80-e2ed70b7cf81 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:48.930111 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f0fec21f-630b-4cf3-ba80-e2ed70b7cf81 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:48.930886 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f0fec21f-630b-4cf3-ba80-e2ed70b7cf81 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:48.931329 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f0fec21f-630b-4cf3-ba80-e2ed70b7cf81 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:49.073312 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.objects.instance [None req-f0fec21f-630b-4cf3-ba80-e2ed70b7cf81 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lazy-loading 'services' on Instance uuid dfa35d29-db7d-4fab-a001-7db0d508d70a {{(pid=115524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:12:49.229145 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f0fec21f-630b-4cf3-ba80-e2ed70b7cf81 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "DELETE /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a/os-volume_attachments/0345609c-84ca-4607-b487-e6cb821e3dac" status: 202 len: 0 microversion: 2.1 time: 0.310736 Nov 08 16:12:49.229907 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 172/340] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Nov 8 16:12:48 2021] DELETE /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a/os-volume_attachments/0345609c-84ca-4607-b487-e6cb821e3dac => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:12:49.238272 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-51282a12-80ce-442a-b1d1-a156ebd8ea35 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:49.239409 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-51282a12-80ce-442a-b1d1-a156ebd8ea35 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:49.249119 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-51282a12-80ce-442a-b1d1-a156ebd8ea35 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:49.250030 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-51282a12-80ce-442a-b1d1-a156ebd8ea35 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:49.251165 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-51282a12-80ce-442a-b1d1-a156ebd8ea35 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:49.251684 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-51282a12-80ce-442a-b1d1-a156ebd8ea35 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:49.286121 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-51282a12-80ce-442a-b1d1-a156ebd8ea35 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049972 Nov 08 16:12:49.286982 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 169/341] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:12:49 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:12:49.461314 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4f74c048-8f70-4e94-95e2-d10c0b88b422 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:49.462393 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4f74c048-8f70-4e94-95e2-d10c0b88b422 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:49.468477 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4f74c048-8f70-4e94-95e2-d10c0b88b422 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:49.468923 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4f74c048-8f70-4e94-95e2-d10c0b88b422 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:49.469685 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4f74c048-8f70-4e94-95e2-d10c0b88b422 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:49.470146 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4f74c048-8f70-4e94-95e2-d10c0b88b422 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:49.499477 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-25d901ff-63d0-4c55-beac-ae66dd78f73a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:49.501175 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-25d901ff-63d0-4c55-beac-ae66dd78f73a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:49.506987 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25d901ff-63d0-4c55-beac-ae66dd78f73a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:49.507546 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25d901ff-63d0-4c55-beac-ae66dd78f73a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:49.508394 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25d901ff-63d0-4c55-beac-ae66dd78f73a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:49.508887 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25d901ff-63d0-4c55-beac-ae66dd78f73a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:49.554154 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4f74c048-8f70-4e94-95e2-d10c0b88b422 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 23787 microversion: 2.1 time: 0.097125 Nov 08 16:12:49.554828 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 173/342] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:49 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 23787 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:12:49.758072 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-25d901ff-63d0-4c55-beac-ae66dd78f73a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 23795 microversion: 2.20 time: 0.262535 Nov 08 16:12:49.758774 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 170/343] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:49 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 23795 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:12:49.783539 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7707f74d-e050-4ae4-8d06-546841b8c65f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:49.784240 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7707f74d-e050-4ae4-8d06-546841b8c65f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:49.792022 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7707f74d-e050-4ae4-8d06-546841b8c65f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:49.792477 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7707f74d-e050-4ae4-8d06-546841b8c65f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:49.793277 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7707f74d-e050-4ae4-8d06-546841b8c65f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:49.793728 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7707f74d-e050-4ae4-8d06-546841b8c65f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:49.930678 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7707f74d-e050-4ae4-8d06-546841b8c65f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:49.938055 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7707f74d-e050-4ae4-8d06-546841b8c65f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.158640 Nov 08 16:12:49.938609 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 174/344] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:49 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:50.298627 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-75f56c5a-bdad-49f2-be64-b70edd5322ed tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:50.299629 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-75f56c5a-bdad-49f2-be64-b70edd5322ed tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:50.306849 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-75f56c5a-bdad-49f2-be64-b70edd5322ed tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:50.307287 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-75f56c5a-bdad-49f2-be64-b70edd5322ed tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:50.308047 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-75f56c5a-bdad-49f2-be64-b70edd5322ed tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:50.308468 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-75f56c5a-bdad-49f2-be64-b70edd5322ed tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:50.338755 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-75f56c5a-bdad-49f2-be64-b70edd5322ed tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044182 Nov 08 16:12:50.339306 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 171/345] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:12:50 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:12:50.565875 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-fa18e7c9-8b03-4945-904f-1db6675eb5eb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:50.568121 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-fa18e7c9-8b03-4945-904f-1db6675eb5eb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:50.576810 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fa18e7c9-8b03-4945-904f-1db6675eb5eb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:50.577920 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fa18e7c9-8b03-4945-904f-1db6675eb5eb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:50.578928 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fa18e7c9-8b03-4945-904f-1db6675eb5eb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:50.579568 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fa18e7c9-8b03-4945-904f-1db6675eb5eb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:50.668374 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-fa18e7c9-8b03-4945-904f-1db6675eb5eb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 24370 microversion: 2.1 time: 0.106307 Nov 08 16:12:50.669032 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 175/346] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:50 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 24370 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:12:50.769240 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f2c446d5-2d8e-4b9d-a32a-01db9b3e0e1c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:50.770186 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f2c446d5-2d8e-4b9d-a32a-01db9b3e0e1c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:50.776892 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f2c446d5-2d8e-4b9d-a32a-01db9b3e0e1c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:50.777334 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f2c446d5-2d8e-4b9d-a32a-01db9b3e0e1c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:50.778144 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f2c446d5-2d8e-4b9d-a32a-01db9b3e0e1c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:50.778573 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f2c446d5-2d8e-4b9d-a32a-01db9b3e0e1c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:50.861990 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f2c446d5-2d8e-4b9d-a32a-01db9b3e0e1c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 24480 microversion: 2.20 time: 0.096209 Nov 08 16:12:50.862616 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 172/347] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:50 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 24480 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:12:50.956211 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5a13fbf6-6c5e-4434-95a8-cf63686bf2a1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:50.956821 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5a13fbf6-6c5e-4434-95a8-cf63686bf2a1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:50.963835 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5a13fbf6-6c5e-4434-95a8-cf63686bf2a1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:50.964282 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5a13fbf6-6c5e-4434-95a8-cf63686bf2a1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:50.965059 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5a13fbf6-6c5e-4434-95a8-cf63686bf2a1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:50.965489 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5a13fbf6-6c5e-4434-95a8-cf63686bf2a1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:51.097210 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-5a13fbf6-6c5e-4434-95a8-cf63686bf2a1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:51.104360 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5a13fbf6-6c5e-4434-95a8-cf63686bf2a1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.152455 Nov 08 16:12:51.104915 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 176/348] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:50 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:51.350248 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8add05c0-d5b5-44c0-80a6-c13cd93d06ca tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:51.351732 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8add05c0-d5b5-44c0-80a6-c13cd93d06ca tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:51.358617 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8add05c0-d5b5-44c0-80a6-c13cd93d06ca tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:51.359055 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8add05c0-d5b5-44c0-80a6-c13cd93d06ca tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:51.359826 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8add05c0-d5b5-44c0-80a6-c13cd93d06ca tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:51.360243 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8add05c0-d5b5-44c0-80a6-c13cd93d06ca tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:51.399376 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8add05c0-d5b5-44c0-80a6-c13cd93d06ca tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053118 Nov 08 16:12:51.399951 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 173/349] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:12:51 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:12:51.552158 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-17435346-b4f1-4355-bc6a-e0a31c0d11fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-163587018", "imageRef": "9abeafba-e602-4e0a-aab2-62160562de06", "flavorRef": "452", "networks": [{"uuid": "f70ee550-62a6-48db-bca5-a0b964bbcce9"}]}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:51.603013 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.network.neutron [None req-17435346-b4f1-4355-bc6a-e0a31c0d11fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] validate_networks() for [('f70ee550-62a6-48db-bca5-a0b964bbcce9', None, None, None, None, None)] {{(pid=115524) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:12:51.681227 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6cf15695-27c6-4e6e-94cd-b104fc699459 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:51.682293 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6cf15695-27c6-4e6e-94cd-b104fc699459 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:51.688994 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6cf15695-27c6-4e6e-94cd-b104fc699459 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:51.689429 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6cf15695-27c6-4e6e-94cd-b104fc699459 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:51.690249 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6cf15695-27c6-4e6e-94cd-b104fc699459 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:51.690673 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6cf15695-27c6-4e6e-94cd-b104fc699459 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:51.791676 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6cf15695-27c6-4e6e-94cd-b104fc699459 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 25354 microversion: 2.1 time: 0.115303 Nov 08 16:12:51.795590 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 174/350] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:51 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 25354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:12:51.873830 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-dc8d763d-0a52-4903-9e24-0474aa6169c2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:51.874825 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-dc8d763d-0a52-4903-9e24-0474aa6169c2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:51.881673 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dc8d763d-0a52-4903-9e24-0474aa6169c2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:51.882150 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dc8d763d-0a52-4903-9e24-0474aa6169c2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:51.882967 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dc8d763d-0a52-4903-9e24-0474aa6169c2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:51.883400 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dc8d763d-0a52-4903-9e24-0474aa6169c2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:51.957274 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-17435346-b4f1-4355-bc6a-e0a31c0d11fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Flavor limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:12:51.957694 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-17435346-b4f1-4355-bc6a-e0a31c0d11fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Image limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:12:51.958194 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-17435346-b4f1-4355-bc6a-e0a31c0d11fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Flavor pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:12:51.958617 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-17435346-b4f1-4355-bc6a-e0a31c0d11fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Image pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:12:51.959105 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-17435346-b4f1-4355-bc6a-e0a31c0d11fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:12:51.967483 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-dc8d763d-0a52-4903-9e24-0474aa6169c2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 25316 microversion: 2.20 time: 0.097751 Nov 08 16:12:51.968187 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 175/351] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:51 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 25316 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:12:51.969845 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-17435346-b4f1-4355-bc6a-e0a31c0d11fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:51.970266 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-17435346-b4f1-4355-bc6a-e0a31c0d11fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:51.971079 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-17435346-b4f1-4355-bc6a-e0a31c0d11fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:51.971509 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-17435346-b4f1-4355-bc6a-e0a31c0d11fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:51.989152 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-17435346-b4f1-4355-bc6a-e0a31c0d11fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Getting quotas for project 549e9715f7424ff5b3b252f354adafe9. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:12:51.993106 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-17435346-b4f1-4355-bc6a-e0a31c0d11fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Getting quotas for user fc7bdbcc6f4845d590103ec01173c2cb and project 549e9715f7424ff5b3b252f354adafe9. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:12:52.004666 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-17435346-b4f1-4355-bc6a-e0a31c0d11fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Going to run 1 instances... {{(pid=115524) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:12:52.007010 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-17435346-b4f1-4355-bc6a-e0a31c0d11fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9abeafba-e602-4e0a-aab2-62160562de06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:12:52.057746 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-17435346-b4f1-4355-bc6a-e0a31c0d11fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509113 Nov 08 16:12:52.061471 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 177/352] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Nov 8 16:12:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 08 16:12:52.081276 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-810dce65-00d0-43c6-aff5-e9d62eebf143 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:52.082036 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-810dce65-00d0-43c6-aff5-e9d62eebf143 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:52.120002 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-8118862c-135a-4851-b291-0de4101f6ed5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:52.120829 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-8118862c-135a-4851-b291-0de4101f6ed5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:52.135047 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8118862c-135a-4851-b291-0de4101f6ed5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:52.135403 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8118862c-135a-4851-b291-0de4101f6ed5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:52.136272 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8118862c-135a-4851-b291-0de4101f6ed5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:52.136714 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8118862c-135a-4851-b291-0de4101f6ed5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:52.158538 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-810dce65-00d0-43c6-aff5-e9d62eebf143 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:52.165697 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-810dce65-00d0-43c6-aff5-e9d62eebf143 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1217 microversion: 2.1 time: 0.100950 Nov 08 16:12:52.166368 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 176/353] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:52 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:52.284948 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-8118862c-135a-4851-b291-0de4101f6ed5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:52.295368 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-8118862c-135a-4851-b291-0de4101f6ed5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.178862 Nov 08 16:12:52.296248 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 178/354] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:52 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:52.803121 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-034219aa-0a94-404c-a3a6-78481ed7671c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:52.804089 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-034219aa-0a94-404c-a3a6-78481ed7671c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:52.810529 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-034219aa-0a94-404c-a3a6-78481ed7671c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:52.811039 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-034219aa-0a94-404c-a3a6-78481ed7671c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:52.811752 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-034219aa-0a94-404c-a3a6-78481ed7671c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:52.812371 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-034219aa-0a94-404c-a3a6-78481ed7671c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:52.971693 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-034219aa-0a94-404c-a3a6-78481ed7671c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 26029 microversion: 2.1 time: 0.172095 Nov 08 16:12:52.972359 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 177/355] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:52 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 26029 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:12:52.979336 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-fd41614c-2576-46a4-b2d7-5d4075bbe642 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:52.980300 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-fd41614c-2576-46a4-b2d7-5d4075bbe642 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:52.986605 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fd41614c-2576-46a4-b2d7-5d4075bbe642 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:52.987055 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fd41614c-2576-46a4-b2d7-5d4075bbe642 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:52.987820 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fd41614c-2576-46a4-b2d7-5d4075bbe642 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:52.988245 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fd41614c-2576-46a4-b2d7-5d4075bbe642 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:53.102442 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-fd41614c-2576-46a4-b2d7-5d4075bbe642 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 26033 microversion: 2.20 time: 0.126589 Nov 08 16:12:53.103204 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 179/356] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:52 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 26033 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:12:53.183881 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c62b46cd-d8ac-420b-b111-20dd30bdaf58 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:53.184555 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c62b46cd-d8ac-420b-b111-20dd30bdaf58 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:53.191421 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c62b46cd-d8ac-420b-b111-20dd30bdaf58 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:53.191856 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c62b46cd-d8ac-420b-b111-20dd30bdaf58 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:53.192610 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c62b46cd-d8ac-420b-b111-20dd30bdaf58 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:53.193035 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c62b46cd-d8ac-420b-b111-20dd30bdaf58 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:53.254250 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c62b46cd-d8ac-420b-b111-20dd30bdaf58 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:53.262074 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c62b46cd-d8ac-420b-b111-20dd30bdaf58 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1269 microversion: 2.1 time: 0.083018 Nov 08 16:12:53.262630 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 178/357] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:53 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1269 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:53.312812 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b8517ffb-c5ff-40a3-92b6-61f6d2c1b756 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:53.313685 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b8517ffb-c5ff-40a3-92b6-61f6d2c1b756 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:53.320790 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b8517ffb-c5ff-40a3-92b6-61f6d2c1b756 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:53.321227 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b8517ffb-c5ff-40a3-92b6-61f6d2c1b756 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:53.322036 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b8517ffb-c5ff-40a3-92b6-61f6d2c1b756 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:53.322461 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b8517ffb-c5ff-40a3-92b6-61f6d2c1b756 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:53.483116 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b8517ffb-c5ff-40a3-92b6-61f6d2c1b756 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:53.492472 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b8517ffb-c5ff-40a3-92b6-61f6d2c1b756 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.183493 Nov 08 16:12:53.502942 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 180/358] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:53 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:53.983329 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c3056369-7fc8-4a69-bc8d-0c17a12d0f38 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:53.984272 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c3056369-7fc8-4a69-bc8d-0c17a12d0f38 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:53.990447 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c3056369-7fc8-4a69-bc8d-0c17a12d0f38 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:53.990893 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c3056369-7fc8-4a69-bc8d-0c17a12d0f38 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:53.992194 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c3056369-7fc8-4a69-bc8d-0c17a12d0f38 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:53.992792 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c3056369-7fc8-4a69-bc8d-0c17a12d0f38 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:54.113500 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-df751721-d9e8-44d9-b0a0-5ddaf252baee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:54.114457 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-df751721-d9e8-44d9-b0a0-5ddaf252baee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:54.124402 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-df751721-d9e8-44d9-b0a0-5ddaf252baee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:54.125157 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-df751721-d9e8-44d9-b0a0-5ddaf252baee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:54.125805 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c3056369-7fc8-4a69-bc8d-0c17a12d0f38 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 26591 microversion: 2.1 time: 0.145805 Nov 08 16:12:54.127130 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 179/359] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:53 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 26591 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:12:54.128443 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-df751721-d9e8-44d9-b0a0-5ddaf252baee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:54.129095 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-df751721-d9e8-44d9-b0a0-5ddaf252baee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:54.251435 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-df751721-d9e8-44d9-b0a0-5ddaf252baee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 26700 microversion: 2.20 time: 0.140696 Nov 08 16:12:54.252986 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 181/360] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:54 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 26700 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:12:54.280850 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0e5ae299-224d-40a6-b954-aa498fb32036 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:54.281646 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0e5ae299-224d-40a6-b954-aa498fb32036 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:54.290930 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0e5ae299-224d-40a6-b954-aa498fb32036 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:54.291465 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0e5ae299-224d-40a6-b954-aa498fb32036 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:54.292328 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0e5ae299-224d-40a6-b954-aa498fb32036 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:54.292867 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0e5ae299-224d-40a6-b954-aa498fb32036 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:54.510927 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e387ba09-b2db-4b7b-b35b-2eb4595d808a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:54.511750 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e387ba09-b2db-4b7b-b35b-2eb4595d808a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:54.519289 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e387ba09-b2db-4b7b-b35b-2eb4595d808a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:54.520032 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e387ba09-b2db-4b7b-b35b-2eb4595d808a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:54.521196 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e387ba09-b2db-4b7b-b35b-2eb4595d808a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:54.521880 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e387ba09-b2db-4b7b-b35b-2eb4595d808a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:54.694067 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0e5ae299-224d-40a6-b954-aa498fb32036 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:54.710914 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0e5ae299-224d-40a6-b954-aa498fb32036 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1317 microversion: 2.1 time: 0.434113 Nov 08 16:12:54.711558 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 180/361] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:54 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1317 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:54.828589 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e387ba09-b2db-4b7b-b35b-2eb4595d808a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:54.837115 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e387ba09-b2db-4b7b-b35b-2eb4595d808a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.330810 Nov 08 16:12:54.837792 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 182/362] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:54 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:55.139084 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b458b720-58ea-4cf5-b1e6-eb2423f86ad2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:55.140032 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b458b720-58ea-4cf5-b1e6-eb2423f86ad2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:55.146948 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b458b720-58ea-4cf5-b1e6-eb2423f86ad2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:55.147390 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b458b720-58ea-4cf5-b1e6-eb2423f86ad2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:55.148239 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b458b720-58ea-4cf5-b1e6-eb2423f86ad2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:55.148660 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b458b720-58ea-4cf5-b1e6-eb2423f86ad2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:55.192695 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-77640e91-b400-4cf3-9d57-879a1034edad req-c54aeaa9-5106-4ac1-9178-7d79c2cdc377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1400ac35-c2ae-4814-ac9b-d18094175dce", "tag": "b2d31fb8-0a87-4aea-8200-914cd468d395"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:55.194219 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:12:55.194219 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:12:55.203312 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-77640e91-b400-4cf3-9d57-879a1034edad req-c54aeaa9-5106-4ac1-9178-7d79c2cdc377 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:55.203755 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-77640e91-b400-4cf3-9d57-879a1034edad req-c54aeaa9-5106-4ac1-9178-7d79c2cdc377 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:55.216400 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-77640e91-b400-4cf3-9d57-879a1034edad req-c54aeaa9-5106-4ac1-9178-7d79c2cdc377 service nova] Creating event network-changed:b2d31fb8-0a87-4aea-8200-914cd468d395 for instance 1400ac35-c2ae-4814-ac9b-d18094175dce on hv-cinder-81618 Nov 08 16:12:55.220899 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-77640e91-b400-4cf3-9d57-879a1034edad req-c54aeaa9-5106-4ac1-9178-7d79c2cdc377 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031844 Nov 08 16:12:55.221486 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 183/363] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:12:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:12:55.255707 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b458b720-58ea-4cf5-b1e6-eb2423f86ad2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 27139 microversion: 2.1 time: 0.120364 Nov 08 16:12:55.256427 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 181/364] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:55 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 27139 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:12:55.264258 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9e337e8c-a448-486f-aa25-2fd4b58dea9b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:55.265260 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9e337e8c-a448-486f-aa25-2fd4b58dea9b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:55.272896 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9e337e8c-a448-486f-aa25-2fd4b58dea9b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:55.274148 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9e337e8c-a448-486f-aa25-2fd4b58dea9b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:55.275258 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9e337e8c-a448-486f-aa25-2fd4b58dea9b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:55.276194 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9e337e8c-a448-486f-aa25-2fd4b58dea9b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:55.409154 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9e337e8c-a448-486f-aa25-2fd4b58dea9b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 27112 microversion: 2.20 time: 0.148777 Nov 08 16:12:55.409826 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 184/365] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:55 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 27112 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:12:55.728829 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-249fe8ab-ee33-4ea5-9c32-1de44267e817 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:55.729626 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-249fe8ab-ee33-4ea5-9c32-1de44267e817 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:55.736657 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-249fe8ab-ee33-4ea5-9c32-1de44267e817 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:55.737378 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-249fe8ab-ee33-4ea5-9c32-1de44267e817 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:55.738887 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-249fe8ab-ee33-4ea5-9c32-1de44267e817 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:55.738887 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-249fe8ab-ee33-4ea5-9c32-1de44267e817 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:55.855953 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-27b4cb36-762e-48b7-8b58-3ca230f7930b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:55.863800 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-27b4cb36-762e-48b7-8b58-3ca230f7930b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:55.873058 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-27b4cb36-762e-48b7-8b58-3ca230f7930b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:55.880319 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-27b4cb36-762e-48b7-8b58-3ca230f7930b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:55.896753 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-27b4cb36-762e-48b7-8b58-3ca230f7930b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:55.897422 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-27b4cb36-762e-48b7-8b58-3ca230f7930b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:55.963774 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-249fe8ab-ee33-4ea5-9c32-1de44267e817 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:55.973428 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-249fe8ab-ee33-4ea5-9c32-1de44267e817 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1317 microversion: 2.1 time: 0.248697 Nov 08 16:12:55.977871 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 182/366] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:55 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:56.147800 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-27b4cb36-762e-48b7-8b58-3ca230f7930b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:56.155721 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-27b4cb36-762e-48b7-8b58-3ca230f7930b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1522 microversion: 2.1 time: 0.305167 Nov 08 16:12:56.156374 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 185/367] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:55 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:12:56.270647 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1400626c-f904-4e8e-8773-bb978e4ca6d1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:56.271568 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1400626c-f904-4e8e-8773-bb978e4ca6d1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:56.284446 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1400626c-f904-4e8e-8773-bb978e4ca6d1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:56.285194 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1400626c-f904-4e8e-8773-bb978e4ca6d1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:56.286239 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1400626c-f904-4e8e-8773-bb978e4ca6d1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:56.286816 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1400626c-f904-4e8e-8773-bb978e4ca6d1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:56.421598 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-53041360-db06-4602-b4cc-5b441d9e0b53 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:56.422861 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-53041360-db06-4602-b4cc-5b441d9e0b53 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:56.436414 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1400626c-f904-4e8e-8773-bb978e4ca6d1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 27546 microversion: 2.1 time: 0.169605 Nov 08 16:12:56.437118 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 183/368] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:56 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 27546 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:12:56.442988 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-53041360-db06-4602-b4cc-5b441d9e0b53 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:56.443436 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-53041360-db06-4602-b4cc-5b441d9e0b53 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:56.446710 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-53041360-db06-4602-b4cc-5b441d9e0b53 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:56.449471 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-53041360-db06-4602-b4cc-5b441d9e0b53 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:56.891183 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-53041360-db06-4602-b4cc-5b441d9e0b53 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 27578 microversion: 2.20 time: 0.474008 Nov 08 16:12:56.891818 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 186/369] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:56 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 27578 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:12:56.997324 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-14fb410e-bb9f-4cd5-bf28-789d374205e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:56.998038 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-14fb410e-bb9f-4cd5-bf28-789d374205e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:57.004987 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-14fb410e-bb9f-4cd5-bf28-789d374205e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:57.005426 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-14fb410e-bb9f-4cd5-bf28-789d374205e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:57.006225 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-14fb410e-bb9f-4cd5-bf28-789d374205e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:57.006654 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-14fb410e-bb9f-4cd5-bf28-789d374205e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:57.152737 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-14fb410e-bb9f-4cd5-bf28-789d374205e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:57.160152 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-14fb410e-bb9f-4cd5-bf28-789d374205e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1317 microversion: 2.1 time: 0.166732 Nov 08 16:12:57.160924 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 184/370] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:56 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:57.177153 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-83ea161f-49d4-4108-a523-1d12dbadcf33 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:57.178105 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-83ea161f-49d4-4108-a523-1d12dbadcf33 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:57.188274 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-83ea161f-49d4-4108-a523-1d12dbadcf33 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:57.188274 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-83ea161f-49d4-4108-a523-1d12dbadcf33 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:57.188274 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-83ea161f-49d4-4108-a523-1d12dbadcf33 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:57.188274 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-83ea161f-49d4-4108-a523-1d12dbadcf33 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:57.323751 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-83ea161f-49d4-4108-a523-1d12dbadcf33 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:57.331015 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-83ea161f-49d4-4108-a523-1d12dbadcf33 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1502 microversion: 2.1 time: 0.159186 Nov 08 16:12:57.331584 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 187/371] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:57 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:57.346941 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b85099e2-ea1a-437b-8b85-9b815af4d827 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:57.347542 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b85099e2-ea1a-437b-8b85-9b815af4d827 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:57.354302 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b85099e2-ea1a-437b-8b85-9b815af4d827 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:57.354740 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b85099e2-ea1a-437b-8b85-9b815af4d827 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:57.355508 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b85099e2-ea1a-437b-8b85-9b815af4d827 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:57.355939 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b85099e2-ea1a-437b-8b85-9b815af4d827 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:57.448203 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-58238131-59f1-48ca-af9f-2932f892a316 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:57.449564 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-58238131-59f1-48ca-af9f-2932f892a316 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:57.456465 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-58238131-59f1-48ca-af9f-2932f892a316 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:57.457271 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-58238131-59f1-48ca-af9f-2932f892a316 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:57.458215 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-58238131-59f1-48ca-af9f-2932f892a316 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:57.458799 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-58238131-59f1-48ca-af9f-2932f892a316 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:57.497544 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b85099e2-ea1a-437b-8b85-9b815af4d827 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:57.505129 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b85099e2-ea1a-437b-8b85-9b815af4d827 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1514 microversion: 2.1 time: 0.161971 Nov 08 16:12:57.505685 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 185/372] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:57 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:57.559617 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-58238131-59f1-48ca-af9f-2932f892a316 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 27650 microversion: 2.1 time: 0.115646 Nov 08 16:12:57.560487 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 188/373] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:57 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 27650 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:12:57.902728 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-44ecc1cc-7841-4c27-9f3b-bf15d9da7935 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:57.903857 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-44ecc1cc-7841-4c27-9f3b-bf15d9da7935 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:57.910145 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-44ecc1cc-7841-4c27-9f3b-bf15d9da7935 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:57.910528 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-44ecc1cc-7841-4c27-9f3b-bf15d9da7935 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:57.911291 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-44ecc1cc-7841-4c27-9f3b-bf15d9da7935 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:57.911719 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-44ecc1cc-7841-4c27-9f3b-bf15d9da7935 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:58.013697 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-44ecc1cc-7841-4c27-9f3b-bf15d9da7935 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 27756 microversion: 2.20 time: 0.114574 Nov 08 16:12:58.014843 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 186/374] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:57 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 27756 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:12:58.179016 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-42c2d905-0f58-4fed-bffa-b9e87f3504b4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:58.180313 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-42c2d905-0f58-4fed-bffa-b9e87f3504b4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:58.187299 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-42c2d905-0f58-4fed-bffa-b9e87f3504b4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:58.187740 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-42c2d905-0f58-4fed-bffa-b9e87f3504b4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:58.188643 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-42c2d905-0f58-4fed-bffa-b9e87f3504b4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:58.189075 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-42c2d905-0f58-4fed-bffa-b9e87f3504b4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:58.334059 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-42c2d905-0f58-4fed-bffa-b9e87f3504b4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:58.343413 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-42c2d905-0f58-4fed-bffa-b9e87f3504b4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1317 microversion: 2.1 time: 0.170509 Nov 08 16:12:58.344103 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 189/375] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:58 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:58.572893 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ae176c8f-d604-4e4a-8304-251752547b13 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:58.573976 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ae176c8f-d604-4e4a-8304-251752547b13 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:58.580902 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ae176c8f-d604-4e4a-8304-251752547b13 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:58.581349 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ae176c8f-d604-4e4a-8304-251752547b13 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:58.582157 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ae176c8f-d604-4e4a-8304-251752547b13 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:58.582587 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ae176c8f-d604-4e4a-8304-251752547b13 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:58.674404 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ae176c8f-d604-4e4a-8304-251752547b13 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 27856 microversion: 2.1 time: 0.105922 Nov 08 16:12:58.675046 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 187/376] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:58 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 27856 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:12:59.026417 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e230e79c-2dd1-4bd4-967f-9750256b1018 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:59.027563 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e230e79c-2dd1-4bd4-967f-9750256b1018 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:59.034690 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e230e79c-2dd1-4bd4-967f-9750256b1018 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:59.035214 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e230e79c-2dd1-4bd4-967f-9750256b1018 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:59.036072 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e230e79c-2dd1-4bd4-967f-9750256b1018 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:59.036509 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e230e79c-2dd1-4bd4-967f-9750256b1018 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:59.139696 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e230e79c-2dd1-4bd4-967f-9750256b1018 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 27927 microversion: 2.20 time: 0.117668 Nov 08 16:12:59.140344 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 190/377] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:12:59 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 27927 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:12:59.360265 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-075d6d45-aba5-4add-bd33-afcb881e740e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:12:59.360984 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-075d6d45-aba5-4add-bd33-afcb881e740e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:59.373748 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-075d6d45-aba5-4add-bd33-afcb881e740e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:59.373748 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-075d6d45-aba5-4add-bd33-afcb881e740e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:59.373748 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-075d6d45-aba5-4add-bd33-afcb881e740e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:59.373748 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-075d6d45-aba5-4add-bd33-afcb881e740e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:59.505966 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-075d6d45-aba5-4add-bd33-afcb881e740e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:12:59.514158 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-075d6d45-aba5-4add-bd33-afcb881e740e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1317 microversion: 2.1 time: 0.157784 Nov 08 16:12:59.514717 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 188/378] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:12:59 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:12:59.689533 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e5a99b01-f69e-409b-a84f-446341007a1a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:59.690701 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e5a99b01-f69e-409b-a84f-446341007a1a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:59.698174 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e5a99b01-f69e-409b-a84f-446341007a1a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:59.699187 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e5a99b01-f69e-409b-a84f-446341007a1a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:59.708730 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e5a99b01-f69e-409b-a84f-446341007a1a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:59.709257 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e5a99b01-f69e-409b-a84f-446341007a1a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:59.851564 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e5a99b01-f69e-409b-a84f-446341007a1a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28034 microversion: 2.1 time: 0.166779 Nov 08 16:12:59.852370 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 191/379] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:59 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28034 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:12:59.908551 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8201b101-afbc-4804-920c-08ffb7fe4248 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:12:59.909482 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8201b101-afbc-4804-920c-08ffb7fe4248 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:12:59.915999 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8201b101-afbc-4804-920c-08ffb7fe4248 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:59.916442 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8201b101-afbc-4804-920c-08ffb7fe4248 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:59.917222 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8201b101-afbc-4804-920c-08ffb7fe4248 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:12:59.917652 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8201b101-afbc-4804-920c-08ffb7fe4248 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:12:59.943118 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.objects.instance [None req-8201b101-afbc-4804-920c-08ffb7fe4248 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lazy-loading 'flavor' on Instance uuid 44f7e3a8-0064-42ad-9e41-03a1ba050703 {{(pid=115523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:13:00.051485 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8201b101-afbc-4804-920c-08ffb7fe4248 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "POST /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/action" status: 200 len: 32 microversion: 2.1 time: 0.146635 Nov 08 16:13:00.052150 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 189/380] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:12:59 2021] POST /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/action => generated 32 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:13:00.063375 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-cb57fe96-f240-43be-b3c3-20c34a6ce84b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:00.064630 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-cb57fe96-f240-43be-b3c3-20c34a6ce84b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:00.074324 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cb57fe96-f240-43be-b3c3-20c34a6ce84b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:00.074780 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cb57fe96-f240-43be-b3c3-20c34a6ce84b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:00.076013 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cb57fe96-f240-43be-b3c3-20c34a6ce84b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:00.076448 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cb57fe96-f240-43be-b3c3-20c34a6ce84b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:00.154566 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-09c1741f-4d36-400b-a418-286886ac13a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:00.155978 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-09c1741f-4d36-400b-a418-286886ac13a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:00.167227 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-09c1741f-4d36-400b-a418-286886ac13a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:00.167862 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-09c1741f-4d36-400b-a418-286886ac13a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:00.168771 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-09c1741f-4d36-400b-a418-286886ac13a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:00.169404 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-09c1741f-4d36-400b-a418-286886ac13a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:00.278189 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-09c1741f-4d36-400b-a418-286886ac13a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28054 microversion: 2.20 time: 0.128618 Nov 08 16:13:00.282372 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 190/381] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:00 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28054 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:13:00.318036 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-cb57fe96-f240-43be-b3c3-20c34a6ce84b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:00.328173 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-cb57fe96-f240-43be-b3c3-20c34a6ce84b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.270020 Nov 08 16:13:00.342236 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 192/382] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:00 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:00.538345 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-2b31527b-d54c-4a0d-a935-295c9cd98068 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:00.539436 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-2b31527b-d54c-4a0d-a935-295c9cd98068 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:00.552052 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2b31527b-d54c-4a0d-a935-295c9cd98068 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:00.560175 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2b31527b-d54c-4a0d-a935-295c9cd98068 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:00.561239 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2b31527b-d54c-4a0d-a935-295c9cd98068 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:00.561895 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2b31527b-d54c-4a0d-a935-295c9cd98068 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:00.816498 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-2b31527b-d54c-4a0d-a935-295c9cd98068 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:00.825029 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-2b31527b-d54c-4a0d-a935-295c9cd98068 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1317 microversion: 2.1 time: 0.297296 Nov 08 16:13:00.835306 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 191/383] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:00 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:00.863935 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-894e51f1-c756-4fc9-a6ad-7814e58b3a79 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:00.865231 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-894e51f1-c756-4fc9-a6ad-7814e58b3a79 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:00.878996 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-894e51f1-c756-4fc9-a6ad-7814e58b3a79 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:00.879938 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-894e51f1-c756-4fc9-a6ad-7814e58b3a79 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:00.883305 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-894e51f1-c756-4fc9-a6ad-7814e58b3a79 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:00.884885 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-894e51f1-c756-4fc9-a6ad-7814e58b3a79 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:01.012066 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-894e51f1-c756-4fc9-a6ad-7814e58b3a79 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.151847 Nov 08 16:13:01.012731 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 193/384] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:00 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:01.293685 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-19f18f95-6b84-4f31-a44f-507d44dc6a2f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:01.295354 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-19f18f95-6b84-4f31-a44f-507d44dc6a2f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:01.306987 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-19f18f95-6b84-4f31-a44f-507d44dc6a2f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:01.307372 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-19f18f95-6b84-4f31-a44f-507d44dc6a2f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:01.308996 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-19f18f95-6b84-4f31-a44f-507d44dc6a2f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:01.309978 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-19f18f95-6b84-4f31-a44f-507d44dc6a2f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:01.394931 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-567169c5-322a-42c3-b322-dfe93626d957 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:01.396807 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-567169c5-322a-42c3-b322-dfe93626d957 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:01.411728 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-567169c5-322a-42c3-b322-dfe93626d957 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:01.412833 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-567169c5-322a-42c3-b322-dfe93626d957 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:01.414677 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-567169c5-322a-42c3-b322-dfe93626d957 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:01.415668 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-567169c5-322a-42c3-b322-dfe93626d957 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:01.577040 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-19f18f95-6b84-4f31-a44f-507d44dc6a2f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.288790 Nov 08 16:13:01.578664 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 192/385] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:01 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:01.627601 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-567169c5-322a-42c3-b322-dfe93626d957 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:01.635662 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-567169c5-322a-42c3-b322-dfe93626d957 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.249189 Nov 08 16:13:01.639686 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 194/386] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:01 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:01.842539 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-12bffce1-34af-4803-8730-0cb43ec8ad24 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:01.851934 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-12bffce1-34af-4803-8730-0cb43ec8ad24 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:01.859453 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-12bffce1-34af-4803-8730-0cb43ec8ad24 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:01.859894 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-12bffce1-34af-4803-8730-0cb43ec8ad24 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:01.860663 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-12bffce1-34af-4803-8730-0cb43ec8ad24 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:01.861103 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-12bffce1-34af-4803-8730-0cb43ec8ad24 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:02.023741 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-cf3a6e3d-45ae-4ff1-8188-f4118de6b90b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:02.025232 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-cf3a6e3d-45ae-4ff1-8188-f4118de6b90b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:02.032052 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cf3a6e3d-45ae-4ff1-8188-f4118de6b90b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:02.032747 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cf3a6e3d-45ae-4ff1-8188-f4118de6b90b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:02.034346 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cf3a6e3d-45ae-4ff1-8188-f4118de6b90b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:02.034847 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cf3a6e3d-45ae-4ff1-8188-f4118de6b90b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:02.129375 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-cf3a6e3d-45ae-4ff1-8188-f4118de6b90b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.109086 Nov 08 16:13:02.130057 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 195/387] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:02 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:13:02.295478 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-12bffce1-34af-4803-8730-0cb43ec8ad24 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:02.303406 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-12bffce1-34af-4803-8730-0cb43ec8ad24 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1317 microversion: 2.1 time: 0.465255 Nov 08 16:13:02.304860 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 193/388] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:01 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1317 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:02.591984 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a822735e-2ceb-40ce-9358-cb75c8d68322 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:02.593620 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a822735e-2ceb-40ce-9358-cb75c8d68322 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:02.601318 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a822735e-2ceb-40ce-9358-cb75c8d68322 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:02.601800 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a822735e-2ceb-40ce-9358-cb75c8d68322 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:02.602596 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a822735e-2ceb-40ce-9358-cb75c8d68322 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:02.603047 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a822735e-2ceb-40ce-9358-cb75c8d68322 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:02.652179 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b0bb74bd-86e7-47f1-86de-89e09dfab4ce tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:02.652927 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b0bb74bd-86e7-47f1-86de-89e09dfab4ce tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:02.659867 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b0bb74bd-86e7-47f1-86de-89e09dfab4ce tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:02.660321 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b0bb74bd-86e7-47f1-86de-89e09dfab4ce tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:02.661096 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b0bb74bd-86e7-47f1-86de-89e09dfab4ce tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:02.661698 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b0bb74bd-86e7-47f1-86de-89e09dfab4ce tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:02.696118 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a822735e-2ceb-40ce-9358-cb75c8d68322 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.109452 Nov 08 16:13:02.699225 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 196/389] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:02 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:02.828341 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b0bb74bd-86e7-47f1-86de-89e09dfab4ce tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:02.838900 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b0bb74bd-86e7-47f1-86de-89e09dfab4ce tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.190180 Nov 08 16:13:02.840344 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 194/390] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:02 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:03.142283 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f98a973d-6422-4ab1-8083-3926f75e0fdc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:03.146630 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f98a973d-6422-4ab1-8083-3926f75e0fdc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:03.154270 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f98a973d-6422-4ab1-8083-3926f75e0fdc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:03.154927 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f98a973d-6422-4ab1-8083-3926f75e0fdc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:03.155721 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f98a973d-6422-4ab1-8083-3926f75e0fdc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:03.156389 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f98a973d-6422-4ab1-8083-3926f75e0fdc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:03.232581 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f98a973d-6422-4ab1-8083-3926f75e0fdc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.094349 Nov 08 16:13:03.238002 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 197/391] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:03 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:03.323982 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1af80f86-4002-41e7-88ea-03437c15218d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:03.324680 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1af80f86-4002-41e7-88ea-03437c15218d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:03.336453 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1af80f86-4002-41e7-88ea-03437c15218d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:03.336920 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1af80f86-4002-41e7-88ea-03437c15218d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:03.337761 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1af80f86-4002-41e7-88ea-03437c15218d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:03.338190 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1af80f86-4002-41e7-88ea-03437c15218d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:03.511757 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1af80f86-4002-41e7-88ea-03437c15218d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:03.539781 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1af80f86-4002-41e7-88ea-03437c15218d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1317 microversion: 2.1 time: 0.222611 Nov 08 16:13:03.541552 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 195/392] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:03 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:03.710617 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c417302a-b82e-4007-a3d4-bfb1775cff46 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:03.712264 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c417302a-b82e-4007-a3d4-bfb1775cff46 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:03.720242 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c417302a-b82e-4007-a3d4-bfb1775cff46 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:03.721945 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c417302a-b82e-4007-a3d4-bfb1775cff46 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:03.723420 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c417302a-b82e-4007-a3d4-bfb1775cff46 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:03.724161 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c417302a-b82e-4007-a3d4-bfb1775cff46 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:03.823282 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c417302a-b82e-4007-a3d4-bfb1775cff46 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.117476 Nov 08 16:13:03.824833 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 198/393] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:03 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:13:03.863044 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f6414c42-020f-422c-87d9-155bca2f61ea tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:03.864366 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f6414c42-020f-422c-87d9-155bca2f61ea tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:03.870318 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f6414c42-020f-422c-87d9-155bca2f61ea tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:03.870965 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f6414c42-020f-422c-87d9-155bca2f61ea tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:03.872822 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f6414c42-020f-422c-87d9-155bca2f61ea tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:03.873976 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f6414c42-020f-422c-87d9-155bca2f61ea tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:04.127116 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f6414c42-020f-422c-87d9-155bca2f61ea tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:04.132744 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-07163034-d464-4093-918f-2f544a9f7a2d req-47eacf45-4e02-4289-aa5a-096db08d4f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1400ac35-c2ae-4814-ac9b-d18094175dce", "name": "network-vif-plugged", "status": "completed", "tag": "b2d31fb8-0a87-4aea-8200-914cd468d395"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:04.134270 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:13:04.134270 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:13:04.142547 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f6414c42-020f-422c-87d9-155bca2f61ea tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.288838 Nov 08 16:13:04.148062 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 196/394] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:03 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:04.153623 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-07163034-d464-4093-918f-2f544a9f7a2d req-47eacf45-4e02-4289-aa5a-096db08d4f50 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:04.154094 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-07163034-d464-4093-918f-2f544a9f7a2d req-47eacf45-4e02-4289-aa5a-096db08d4f50 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:04.176934 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-07163034-d464-4093-918f-2f544a9f7a2d req-47eacf45-4e02-4289-aa5a-096db08d4f50 service nova] Creating event network-vif-plugged:b2d31fb8-0a87-4aea-8200-914cd468d395 for instance 1400ac35-c2ae-4814-ac9b-d18094175dce on hv-cinder-81618 Nov 08 16:13:04.188732 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-07163034-d464-4093-918f-2f544a9f7a2d req-47eacf45-4e02-4289-aa5a-096db08d4f50 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059787 Nov 08 16:13:04.198263 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 199/395] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:13:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:13:04.246112 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4fd6d25d-6ebc-4440-a408-d8623c62bc5f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:04.247185 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4fd6d25d-6ebc-4440-a408-d8623c62bc5f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:04.254576 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4fd6d25d-6ebc-4440-a408-d8623c62bc5f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:04.256861 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4fd6d25d-6ebc-4440-a408-d8623c62bc5f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:04.258120 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4fd6d25d-6ebc-4440-a408-d8623c62bc5f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:04.258939 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4fd6d25d-6ebc-4440-a408-d8623c62bc5f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:04.359472 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4fd6d25d-6ebc-4440-a408-d8623c62bc5f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.118173 Nov 08 16:13:04.365031 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 197/396] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:04 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:04.564801 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-715251e8-b755-4fae-b2dc-eb0a8761e638 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:04.565482 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-715251e8-b755-4fae-b2dc-eb0a8761e638 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:04.571989 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-715251e8-b755-4fae-b2dc-eb0a8761e638 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:04.572400 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-715251e8-b755-4fae-b2dc-eb0a8761e638 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:04.573166 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-715251e8-b755-4fae-b2dc-eb0a8761e638 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:04.573589 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-715251e8-b755-4fae-b2dc-eb0a8761e638 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:04.738466 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-715251e8-b755-4fae-b2dc-eb0a8761e638 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:04.746592 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-715251e8-b755-4fae-b2dc-eb0a8761e638 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1317 microversion: 2.1 time: 0.186219 Nov 08 16:13:04.747149 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 200/397] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:04 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:04.836336 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-dd76521f-d2d0-4c59-8e34-ca4d0965b1bc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:04.837541 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-dd76521f-d2d0-4c59-8e34-ca4d0965b1bc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:04.844471 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dd76521f-d2d0-4c59-8e34-ca4d0965b1bc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:04.844907 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dd76521f-d2d0-4c59-8e34-ca4d0965b1bc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:04.845993 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dd76521f-d2d0-4c59-8e34-ca4d0965b1bc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:04.846419 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dd76521f-d2d0-4c59-8e34-ca4d0965b1bc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:04.924522 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-dd76521f-d2d0-4c59-8e34-ca4d0965b1bc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.093307 Nov 08 16:13:04.925264 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 198/398] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:04 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:05.159024 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9e945a12-62d9-4622-9199-7b6fb4acd2a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:05.159632 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9e945a12-62d9-4622-9199-7b6fb4acd2a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:05.166460 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9e945a12-62d9-4622-9199-7b6fb4acd2a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:05.166909 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9e945a12-62d9-4622-9199-7b6fb4acd2a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:05.167681 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9e945a12-62d9-4622-9199-7b6fb4acd2a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:05.168148 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9e945a12-62d9-4622-9199-7b6fb4acd2a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:05.300603 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-9e945a12-62d9-4622-9199-7b6fb4acd2a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:05.307925 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9e945a12-62d9-4622-9199-7b6fb4acd2a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.152576 Nov 08 16:13:05.308481 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 201/399] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:05 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:05.372625 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1deb6cdb-6298-4ec5-8243-1e1000d4ad05 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:05.373960 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1deb6cdb-6298-4ec5-8243-1e1000d4ad05 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:05.380749 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1deb6cdb-6298-4ec5-8243-1e1000d4ad05 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:05.381188 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1deb6cdb-6298-4ec5-8243-1e1000d4ad05 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:05.382023 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1deb6cdb-6298-4ec5-8243-1e1000d4ad05 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:05.382452 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1deb6cdb-6298-4ec5-8243-1e1000d4ad05 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:05.601104 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1deb6cdb-6298-4ec5-8243-1e1000d4ad05 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.232243 Nov 08 16:13:05.601800 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 199/400] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:05 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:05.763055 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bbca1aba-6bff-422a-8b2e-9ccc19c2c02d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:05.763770 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-bbca1aba-6bff-422a-8b2e-9ccc19c2c02d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:05.770063 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bbca1aba-6bff-422a-8b2e-9ccc19c2c02d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:05.770509 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bbca1aba-6bff-422a-8b2e-9ccc19c2c02d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:05.771274 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bbca1aba-6bff-422a-8b2e-9ccc19c2c02d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:05.771705 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bbca1aba-6bff-422a-8b2e-9ccc19c2c02d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:05.899772 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-bbca1aba-6bff-422a-8b2e-9ccc19c2c02d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:05.906948 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bbca1aba-6bff-422a-8b2e-9ccc19c2c02d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1317 microversion: 2.1 time: 0.147517 Nov 08 16:13:05.907507 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 202/401] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:05 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:05.937014 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-258ac0f5-ffdb-4078-b473-2d8e63023d24 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:05.938028 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-258ac0f5-ffdb-4078-b473-2d8e63023d24 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:05.945492 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-258ac0f5-ffdb-4078-b473-2d8e63023d24 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:05.945959 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-258ac0f5-ffdb-4078-b473-2d8e63023d24 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:05.946721 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-258ac0f5-ffdb-4078-b473-2d8e63023d24 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:05.947144 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-258ac0f5-ffdb-4078-b473-2d8e63023d24 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:06.012509 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-258ac0f5-ffdb-4078-b473-2d8e63023d24 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.079219 Nov 08 16:13:06.013228 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 200/402] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:05 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:06.325185 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d481316c-cbe7-42cc-a885-ed028e6419e9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:06.325805 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d481316c-cbe7-42cc-a885-ed028e6419e9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:06.332072 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d481316c-cbe7-42cc-a885-ed028e6419e9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:06.332511 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d481316c-cbe7-42cc-a885-ed028e6419e9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:06.333296 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d481316c-cbe7-42cc-a885-ed028e6419e9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:06.333736 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d481316c-cbe7-42cc-a885-ed028e6419e9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:06.434700 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c9618f6e-4b33-456c-b714-e3901731c63b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1795986439", "imageRef": "9abeafba-e602-4e0a-aab2-62160562de06", "flavorRef": "452", "networks": [{"uuid": "63da175a-847c-472d-b285-2df5d0b798a0"}]}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:06.470481 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-d481316c-cbe7-42cc-a885-ed028e6419e9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:06.478555 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d481316c-cbe7-42cc-a885-ed028e6419e9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.157019 Nov 08 16:13:06.479017 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 203/403] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:06 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:06.487699 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.network.neutron [None req-c9618f6e-4b33-456c-b714-e3901731c63b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] validate_networks() for [('63da175a-847c-472d-b285-2df5d0b798a0', None, None, None, None, None)] {{(pid=115523) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:13:06.612319 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-186d6844-ad32-4021-9fc9-f197992b4d32 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:06.613266 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-186d6844-ad32-4021-9fc9-f197992b4d32 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:06.619193 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-186d6844-ad32-4021-9fc9-f197992b4d32 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:06.619640 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-186d6844-ad32-4021-9fc9-f197992b4d32 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:06.620412 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-186d6844-ad32-4021-9fc9-f197992b4d32 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:06.620841 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-186d6844-ad32-4021-9fc9-f197992b4d32 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:06.704755 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-186d6844-ad32-4021-9fc9-f197992b4d32 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.095990 Nov 08 16:13:06.705403 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 204/404] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:06 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:13:06.832709 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-c9618f6e-4b33-456c-b714-e3901731c63b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Flavor limits 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:13:06.833122 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-c9618f6e-4b33-456c-b714-e3901731c63b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Image limits 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:13:06.833586 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-c9618f6e-4b33-456c-b714-e3901731c63b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Flavor pref 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:13:06.834022 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-c9618f6e-4b33-456c-b714-e3901731c63b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Image pref 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:13:06.834427 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-c9618f6e-4b33-456c-b714-e3901731c63b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:13:06.843268 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c9618f6e-4b33-456c-b714-e3901731c63b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:06.843652 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c9618f6e-4b33-456c-b714-e3901731c63b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:06.844601 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c9618f6e-4b33-456c-b714-e3901731c63b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:06.845049 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c9618f6e-4b33-456c-b714-e3901731c63b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:06.861233 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-c9618f6e-4b33-456c-b714-e3901731c63b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Getting quotas for project e5e827086bb348d190546b9a0c0ba087. Resources: {'instances', 'ram', 'cores'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:13:06.865100 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-c9618f6e-4b33-456c-b714-e3901731c63b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Getting quotas for user e4ef1300b67b41d5a67626dc96347ab5 and project e5e827086bb348d190546b9a0c0ba087. Resources: {'instances', 'ram', 'cores'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:13:06.876806 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c9618f6e-4b33-456c-b714-e3901731c63b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Going to run 1 instances... {{(pid=115523) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:13:06.879241 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c9618f6e-4b33-456c-b714-e3901731c63b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9abeafba-e602-4e0a-aab2-62160562de06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:13:06.923913 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a957daa2-32ba-4667-9e28-e4093a158f8f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:06.924751 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c9618f6e-4b33-456c-b714-e3901731c63b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493957 Nov 08 16:13:06.925064 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a957daa2-32ba-4667-9e28-e4093a158f8f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:06.925532 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 201/405] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Nov 8 16:13:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 08 16:13:06.932747 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a957daa2-32ba-4667-9e28-e4093a158f8f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:06.933311 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a957daa2-32ba-4667-9e28-e4093a158f8f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:06.934411 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a957daa2-32ba-4667-9e28-e4093a158f8f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:06.934949 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a957daa2-32ba-4667-9e28-e4093a158f8f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:06.935354 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d38b6505-5582-4245-afba-071fee5d3904 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:06.935955 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d38b6505-5582-4245-afba-071fee5d3904 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:07.003666 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d38b6505-5582-4245-afba-071fee5d3904 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:07.011899 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d38b6505-5582-4245-afba-071fee5d3904 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1219 microversion: 2.1 time: 0.079955 Nov 08 16:13:07.017969 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 202/406] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:06 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:07.025067 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ad55569a-902f-4ffa-9e41-dd5cc47d244e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:07.026275 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ad55569a-902f-4ffa-9e41-dd5cc47d244e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:07.033018 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ad55569a-902f-4ffa-9e41-dd5cc47d244e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:07.033463 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ad55569a-902f-4ffa-9e41-dd5cc47d244e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:07.034435 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ad55569a-902f-4ffa-9e41-dd5cc47d244e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:07.034863 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ad55569a-902f-4ffa-9e41-dd5cc47d244e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:07.104324 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a957daa2-32ba-4667-9e28-e4093a158f8f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:07.106669 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ad55569a-902f-4ffa-9e41-dd5cc47d244e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.085269 Nov 08 16:13:07.107485 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 203/407] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:07 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:13:07.115636 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a957daa2-32ba-4667-9e28-e4093a158f8f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1507 microversion: 2.1 time: 0.195617 Nov 08 16:13:07.116835 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 205/408] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:06 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1507 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:07.240172 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d5677c92-fedf-430e-8530-ca0e5266d800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1672999044", "imageRef": "9abeafba-e602-4e0a-aab2-62160562de06", "flavorRef": "452", "networks": [{"uuid": "e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e"}]}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:07.301903 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.network.neutron [None req-d5677c92-fedf-430e-8530-ca0e5266d800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] validate_networks() for [('e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e', None, None, None, None, None)] {{(pid=115523) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:13:07.495868 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-83e9b8d2-7754-471c-bc3f-77603153d2a0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:07.496626 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-83e9b8d2-7754-471c-bc3f-77603153d2a0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:07.503535 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-83e9b8d2-7754-471c-bc3f-77603153d2a0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:07.504234 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-83e9b8d2-7754-471c-bc3f-77603153d2a0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:07.505655 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-83e9b8d2-7754-471c-bc3f-77603153d2a0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:07.506316 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-83e9b8d2-7754-471c-bc3f-77603153d2a0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:07.732451 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-83e9b8d2-7754-471c-bc3f-77603153d2a0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:07.741394 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-83e9b8d2-7754-471c-bc3f-77603153d2a0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.248753 Nov 08 16:13:07.747341 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 206/409] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:07 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:07.751256 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3cddea14-98e1-4bb0-867b-779bc2b7aee0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:07.752242 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3cddea14-98e1-4bb0-867b-779bc2b7aee0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:07.756438 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-d5677c92-fedf-430e-8530-ca0e5266d800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Flavor limits 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:13:07.757483 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-d5677c92-fedf-430e-8530-ca0e5266d800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Image limits 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:13:07.758078 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-d5677c92-fedf-430e-8530-ca0e5266d800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Flavor pref 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:13:07.758485 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-d5677c92-fedf-430e-8530-ca0e5266d800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Image pref 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:13:07.758893 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-d5677c92-fedf-430e-8530-ca0e5266d800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:13:07.759085 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3cddea14-98e1-4bb0-867b-779bc2b7aee0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:07.759536 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3cddea14-98e1-4bb0-867b-779bc2b7aee0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:07.760316 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3cddea14-98e1-4bb0-867b-779bc2b7aee0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:07.760752 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3cddea14-98e1-4bb0-867b-779bc2b7aee0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:07.767579 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5677c92-fedf-430e-8530-ca0e5266d800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:07.768027 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5677c92-fedf-430e-8530-ca0e5266d800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:07.768828 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5677c92-fedf-430e-8530-ca0e5266d800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:07.769261 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5677c92-fedf-430e-8530-ca0e5266d800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:07.787331 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-d5677c92-fedf-430e-8530-ca0e5266d800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Getting quotas for project 9580ccbb790e4dff94da99ac8b1c98d5. Resources: {'instances', 'ram', 'cores'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:13:07.791370 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-d5677c92-fedf-430e-8530-ca0e5266d800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Getting quotas for user 39e2605b08484b20b429bb32fab97a39 and project 9580ccbb790e4dff94da99ac8b1c98d5. Resources: {'instances', 'ram', 'cores'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:13:07.802102 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d5677c92-fedf-430e-8530-ca0e5266d800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Going to run 1 instances... {{(pid=115523) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:13:07.805028 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d5677c92-fedf-430e-8530-ca0e5266d800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9abeafba-e602-4e0a-aab2-62160562de06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:13:07.838823 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3cddea14-98e1-4bb0-867b-779bc2b7aee0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.095194 Nov 08 16:13:07.842963 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 207/410] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:07 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:07.851064 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d5677c92-fedf-430e-8530-ca0e5266d800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614341 Nov 08 16:13:07.851700 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 204/411] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Nov 8 16:13:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 16:13:07.861734 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-54ea8200-4bf4-432b-885e-69758c876ff5 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:07.862422 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-54ea8200-4bf4-432b-885e-69758c876ff5 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:07.921478 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-54ea8200-4bf4-432b-885e-69758c876ff5 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:07.929197 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-54ea8200-4bf4-432b-885e-69758c876ff5 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 200 len: 1214 microversion: 2.1 time: 0.071457 Nov 08 16:13:07.930111 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 208/412] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:07 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:08.029425 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a916e44d-832a-4c98-b762-2889a21c4622 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:08.030262 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a916e44d-832a-4c98-b762-2889a21c4622 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:08.037120 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a916e44d-832a-4c98-b762-2889a21c4622 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:08.037653 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a916e44d-832a-4c98-b762-2889a21c4622 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:08.038501 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a916e44d-832a-4c98-b762-2889a21c4622 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:08.038927 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a916e44d-832a-4c98-b762-2889a21c4622 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:08.122648 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f8f2aeef-a521-4fea-a320-8908aed60127 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:08.124240 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f8f2aeef-a521-4fea-a320-8908aed60127 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:08.124900 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a916e44d-832a-4c98-b762-2889a21c4622 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:08.133146 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8f2aeef-a521-4fea-a320-8908aed60127 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:08.133580 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8f2aeef-a521-4fea-a320-8908aed60127 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:08.134416 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8f2aeef-a521-4fea-a320-8908aed60127 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:08.134841 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8f2aeef-a521-4fea-a320-8908aed60127 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:08.142532 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a916e44d-832a-4c98-b762-2889a21c4622 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1279 microversion: 2.1 time: 0.116922 Nov 08 16:13:08.143339 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 205/413] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:08 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1279 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:08.234060 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f8f2aeef-a521-4fea-a320-8908aed60127 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.118589 Nov 08 16:13:08.234956 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 209/414] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:08 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:08.758467 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b5778067-7477-49e5-8fa4-81edd15d294c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:08.759120 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b5778067-7477-49e5-8fa4-81edd15d294c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:08.765282 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b5778067-7477-49e5-8fa4-81edd15d294c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:08.765735 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b5778067-7477-49e5-8fa4-81edd15d294c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:08.766512 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b5778067-7477-49e5-8fa4-81edd15d294c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:08.767018 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b5778067-7477-49e5-8fa4-81edd15d294c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:08.853302 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3b8463da-3597-487b-a901-12e47d43a007 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:08.854653 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3b8463da-3597-487b-a901-12e47d43a007 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:08.861807 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3b8463da-3597-487b-a901-12e47d43a007 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:08.862413 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3b8463da-3597-487b-a901-12e47d43a007 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:08.863585 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3b8463da-3597-487b-a901-12e47d43a007 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:08.864100 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3b8463da-3597-487b-a901-12e47d43a007 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:09.015823 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b5778067-7477-49e5-8fa4-81edd15d294c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:09.023056 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b5778067-7477-49e5-8fa4-81edd15d294c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.268958 Nov 08 16:13:09.023612 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 206/415] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:08 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:09.028592 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d6ed6b55-3d9f-441f-9829-c965b4df4420 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:09.029192 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d6ed6b55-3d9f-441f-9829-c965b4df4420 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:09.037091 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d6ed6b55-3d9f-441f-9829-c965b4df4420 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:09.037531 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d6ed6b55-3d9f-441f-9829-c965b4df4420 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:09.038358 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d6ed6b55-3d9f-441f-9829-c965b4df4420 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:09.038815 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d6ed6b55-3d9f-441f-9829-c965b4df4420 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:09.107542 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d6ed6b55-3d9f-441f-9829-c965b4df4420 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:09.114976 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d6ed6b55-3d9f-441f-9829-c965b4df4420 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 200 len: 1266 microversion: 2.1 time: 0.090282 Nov 08 16:13:09.115613 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 207/416] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:09 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:09.142908 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3b8463da-3597-487b-a901-12e47d43a007 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.295407 Nov 08 16:13:09.145278 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 210/417] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:08 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:13:09.164201 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-43d0974b-9af9-4a2d-968a-a52ac5d47a4d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:09.165154 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-43d0974b-9af9-4a2d-968a-a52ac5d47a4d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:09.172484 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-43d0974b-9af9-4a2d-968a-a52ac5d47a4d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:09.173027 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-43d0974b-9af9-4a2d-968a-a52ac5d47a4d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:09.174271 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-43d0974b-9af9-4a2d-968a-a52ac5d47a4d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:09.174993 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-43d0974b-9af9-4a2d-968a-a52ac5d47a4d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:09.247260 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-26f48aca-3004-4318-8b31-225f78fb6fed tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:09.248533 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-26f48aca-3004-4318-8b31-225f78fb6fed tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:09.282516 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-26f48aca-3004-4318-8b31-225f78fb6fed tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:09.282972 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-26f48aca-3004-4318-8b31-225f78fb6fed tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:09.283756 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-26f48aca-3004-4318-8b31-225f78fb6fed tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:09.284188 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-26f48aca-3004-4318-8b31-225f78fb6fed tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:09.385431 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-26f48aca-3004-4318-8b31-225f78fb6fed tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.142023 Nov 08 16:13:09.386673 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 211/418] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:09 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:09.389176 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-43d0974b-9af9-4a2d-968a-a52ac5d47a4d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:09.407338 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-43d0974b-9af9-4a2d-968a-a52ac5d47a4d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1319 microversion: 2.1 time: 0.247437 Nov 08 16:13:09.408500 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 208/419] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:09 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:09.517330 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-10c5a3c5-c85f-409b-8b5e-3f2354d4de44 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a71de45-abe6-4df0-b3f7-ef822497b72b"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:09.518840 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-10c5a3c5-c85f-409b-8b5e-3f2354d4de44 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:09.526551 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-10c5a3c5-c85f-409b-8b5e-3f2354d4de44 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:09.526995 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-10c5a3c5-c85f-409b-8b5e-3f2354d4de44 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:09.528121 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-10c5a3c5-c85f-409b-8b5e-3f2354d4de44 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:09.528559 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-10c5a3c5-c85f-409b-8b5e-3f2354d4de44 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:09.630496 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-f351a449-02f9-4f17-80e3-8c89d3c18899 req-cc7192b7-506b-46b7-bf14-dc1fcb0d2936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e41a90ba-f4f1-472e-9883-150d31bcc777", "tag": "69152346-0cf4-4b0a-9db9-f1bddb32dc4b"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:09.632898 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:13:09.632898 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:13:09.644841 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-f351a449-02f9-4f17-80e3-8c89d3c18899 req-cc7192b7-506b-46b7-bf14-dc1fcb0d2936 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:09.645570 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-f351a449-02f9-4f17-80e3-8c89d3c18899 req-cc7192b7-506b-46b7-bf14-dc1fcb0d2936 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:09.661028 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-f351a449-02f9-4f17-80e3-8c89d3c18899 req-cc7192b7-506b-46b7-bf14-dc1fcb0d2936 service nova] Creating event network-changed:69152346-0cf4-4b0a-9db9-f1bddb32dc4b for instance e41a90ba-f4f1-472e-9883-150d31bcc777 on hv-cinder-81618 Nov 08 16:13:09.667106 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-f351a449-02f9-4f17-80e3-8c89d3c18899 req-cc7192b7-506b-46b7-bf14-dc1fcb0d2936 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046896 Nov 08 16:13:09.667867 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 209/420] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:13:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:13:09.827611 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-10c5a3c5-c85f-409b-8b5e-3f2354d4de44 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "POST /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314476 Nov 08 16:13:09.829767 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 212/421] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Nov 8 16:13:09 2021] POST /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:13:10.040956 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-38521342-5d26-45f2-af2a-6d5eb1e32a51 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:10.041574 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-38521342-5d26-45f2-af2a-6d5eb1e32a51 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:10.047530 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-38521342-5d26-45f2-af2a-6d5eb1e32a51 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:10.047952 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-38521342-5d26-45f2-af2a-6d5eb1e32a51 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:10.048712 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-38521342-5d26-45f2-af2a-6d5eb1e32a51 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:10.049136 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-38521342-5d26-45f2-af2a-6d5eb1e32a51 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:10.132707 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-854aa6d2-649c-4225-b747-94ec05b624f2 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:10.133404 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-854aa6d2-649c-4225-b747-94ec05b624f2 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:10.140076 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-854aa6d2-649c-4225-b747-94ec05b624f2 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:10.140554 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-854aa6d2-649c-4225-b747-94ec05b624f2 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:10.141335 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-854aa6d2-649c-4225-b747-94ec05b624f2 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:10.141809 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-854aa6d2-649c-4225-b747-94ec05b624f2 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:10.224151 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-38521342-5d26-45f2-af2a-6d5eb1e32a51 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:10.234462 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-38521342-5d26-45f2-af2a-6d5eb1e32a51 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.198017 Nov 08 16:13:10.236916 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 210/422] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:10 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:10.245531 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-331f1cd7-64ad-482b-9631-18c0776115ce tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:10.247353 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-331f1cd7-64ad-482b-9631-18c0776115ce tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:10.253976 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-331f1cd7-64ad-482b-9631-18c0776115ce tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:10.254415 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-331f1cd7-64ad-482b-9631-18c0776115ce tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:10.255244 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-331f1cd7-64ad-482b-9631-18c0776115ce tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:10.255842 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-331f1cd7-64ad-482b-9631-18c0776115ce tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:10.334976 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-331f1cd7-64ad-482b-9631-18c0776115ce tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.095780 Nov 08 16:13:10.335870 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 211/423] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:10 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:10.370126 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-854aa6d2-649c-4225-b747-94ec05b624f2 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:10.377623 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-854aa6d2-649c-4225-b747-94ec05b624f2 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 200 len: 1314 microversion: 2.1 time: 0.249006 Nov 08 16:13:10.378224 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 213/424] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:10 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:10.397293 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5d8d37c4-d6f1-42a1-bee0-004e73afc8ec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:10.398304 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5d8d37c4-d6f1-42a1-bee0-004e73afc8ec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:10.405621 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5d8d37c4-d6f1-42a1-bee0-004e73afc8ec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:10.406099 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5d8d37c4-d6f1-42a1-bee0-004e73afc8ec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:10.406898 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5d8d37c4-d6f1-42a1-bee0-004e73afc8ec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:10.407326 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5d8d37c4-d6f1-42a1-bee0-004e73afc8ec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:10.425613 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9f54d8ae-2ac9-4ef0-a60e-8571ff081821 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:10.427018 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9f54d8ae-2ac9-4ef0-a60e-8571ff081821 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:10.435081 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9f54d8ae-2ac9-4ef0-a60e-8571ff081821 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:10.435856 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9f54d8ae-2ac9-4ef0-a60e-8571ff081821 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:10.437058 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9f54d8ae-2ac9-4ef0-a60e-8571ff081821 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:10.438550 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9f54d8ae-2ac9-4ef0-a60e-8571ff081821 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:10.671714 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-9f54d8ae-2ac9-4ef0-a60e-8571ff081821 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:10.679636 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9f54d8ae-2ac9-4ef0-a60e-8571ff081821 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1319 microversion: 2.1 time: 0.258531 Nov 08 16:13:10.684570 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 214/425] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:10 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:10.848534 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-2e12509b-06a3-474c-b471-ed9f12fad78c req-b61ea8b7-9404-423d-88a5-783e0952fdaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be55525-c510-4909-a898-370d4760deea", "tag": "00b6d387-6249-49c0-81db-f2b5b8a1ce31"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:10.851375 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:13:10.851375 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:13:10.864428 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-2e12509b-06a3-474c-b471-ed9f12fad78c req-b61ea8b7-9404-423d-88a5-783e0952fdaf service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:10.865573 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-2e12509b-06a3-474c-b471-ed9f12fad78c req-b61ea8b7-9404-423d-88a5-783e0952fdaf service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:10.880155 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-2e12509b-06a3-474c-b471-ed9f12fad78c req-b61ea8b7-9404-423d-88a5-783e0952fdaf service nova] Creating event network-changed:00b6d387-6249-49c0-81db-f2b5b8a1ce31 for instance 2be55525-c510-4909-a898-370d4760deea on hv-cinder-81618 Nov 08 16:13:10.886588 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-2e12509b-06a3-474c-b471-ed9f12fad78c req-b61ea8b7-9404-423d-88a5-783e0952fdaf service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042262 Nov 08 16:13:10.887542 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 215/426] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:13:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:13:11.232614 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5d8d37c4-d6f1-42a1-bee0-004e73afc8ec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.839581 Nov 08 16:13:11.233254 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 212/427] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:10 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:11.254613 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-6ac0d158-8c43-4dbd-8850-9723e223727c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:11.255299 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-6ac0d158-8c43-4dbd-8850-9723e223727c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:11.261626 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6ac0d158-8c43-4dbd-8850-9723e223727c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:11.262105 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6ac0d158-8c43-4dbd-8850-9723e223727c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:11.262876 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6ac0d158-8c43-4dbd-8850-9723e223727c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:11.263308 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6ac0d158-8c43-4dbd-8850-9723e223727c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:11.349323 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-7b425746-a24f-49ad-9b94-66d15c421dd5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:11.351004 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-7b425746-a24f-49ad-9b94-66d15c421dd5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:11.359524 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7b425746-a24f-49ad-9b94-66d15c421dd5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:11.360263 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7b425746-a24f-49ad-9b94-66d15c421dd5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:11.361597 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7b425746-a24f-49ad-9b94-66d15c421dd5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:11.362243 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7b425746-a24f-49ad-9b94-66d15c421dd5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:11.412408 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-6ac0d158-8c43-4dbd-8850-9723e223727c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:11.420295 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-6ac0d158-8c43-4dbd-8850-9723e223727c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.169699 Nov 08 16:13:11.420855 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 216/428] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:11 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:11.434479 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-000b40a6-6587-433b-9fc4-2d5887278f36 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:11.435092 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-000b40a6-6587-433b-9fc4-2d5887278f36 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:11.440846 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-000b40a6-6587-433b-9fc4-2d5887278f36 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:11.441293 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-000b40a6-6587-433b-9fc4-2d5887278f36 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:11.442111 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-000b40a6-6587-433b-9fc4-2d5887278f36 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:11.442541 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-000b40a6-6587-433b-9fc4-2d5887278f36 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:11.456334 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-7b425746-a24f-49ad-9b94-66d15c421dd5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.112794 Nov 08 16:13:11.460728 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 213/429] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:11 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:11.575465 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-000b40a6-6587-433b-9fc4-2d5887278f36 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:11.582560 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-000b40a6-6587-433b-9fc4-2d5887278f36 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 200 len: 1314 microversion: 2.1 time: 0.151799 Nov 08 16:13:11.583115 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 217/430] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:11 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:11.696739 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a873980d-fbc0-4949-9ced-f4aea8e7e62e tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:11.697418 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a873980d-fbc0-4949-9ced-f4aea8e7e62e tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:11.704260 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a873980d-fbc0-4949-9ced-f4aea8e7e62e tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:11.704697 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a873980d-fbc0-4949-9ced-f4aea8e7e62e tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:11.705453 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a873980d-fbc0-4949-9ced-f4aea8e7e62e tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:11.705900 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a873980d-fbc0-4949-9ced-f4aea8e7e62e tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:11.833689 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a873980d-fbc0-4949-9ced-f4aea8e7e62e tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:11.841802 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a873980d-fbc0-4949-9ced-f4aea8e7e62e tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1319 microversion: 2.1 time: 0.149053 Nov 08 16:13:11.842409 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 214/431] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:11 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:12.244892 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-52467a1d-c5de-4326-afb9-3d3a7e1752ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:12.246125 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-52467a1d-c5de-4326-afb9-3d3a7e1752ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:12.254273 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-52467a1d-c5de-4326-afb9-3d3a7e1752ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:12.254717 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-52467a1d-c5de-4326-afb9-3d3a7e1752ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:12.255503 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-52467a1d-c5de-4326-afb9-3d3a7e1752ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:12.255933 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-52467a1d-c5de-4326-afb9-3d3a7e1752ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:12.436880 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-7b62ac07-f1b1-4698-af0f-7e5515bd9ea0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:12.437603 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-7b62ac07-f1b1-4698-af0f-7e5515bd9ea0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:12.444761 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7b62ac07-f1b1-4698-af0f-7e5515bd9ea0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:12.445234 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7b62ac07-f1b1-4698-af0f-7e5515bd9ea0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:12.446141 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7b62ac07-f1b1-4698-af0f-7e5515bd9ea0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:12.446572 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7b62ac07-f1b1-4698-af0f-7e5515bd9ea0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:12.562822 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-52467a1d-c5de-4326-afb9-3d3a7e1752ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.322133 Nov 08 16:13:12.565635 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 218/432] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:12 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:12.573756 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-acb96177-a978-42a0-9950-9990af5b4fa6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:12.575101 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-acb96177-a978-42a0-9950-9990af5b4fa6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:12.582250 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-acb96177-a978-42a0-9950-9990af5b4fa6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:12.582701 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-acb96177-a978-42a0-9950-9990af5b4fa6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:12.583682 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-acb96177-a978-42a0-9950-9990af5b4fa6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:12.584110 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-acb96177-a978-42a0-9950-9990af5b4fa6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:12.782751 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7b62ac07-f1b1-4698-af0f-7e5515bd9ea0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:12.789936 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-7b62ac07-f1b1-4698-af0f-7e5515bd9ea0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.357285 Nov 08 16:13:12.790496 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 215/433] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:12 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:12.794755 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f3dd87a6-80f0-48ea-8ef1-5ad6c9ccc1dd tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:12.795344 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f3dd87a6-80f0-48ea-8ef1-5ad6c9ccc1dd tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:12.800514 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f3dd87a6-80f0-48ea-8ef1-5ad6c9ccc1dd tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:12.800955 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f3dd87a6-80f0-48ea-8ef1-5ad6c9ccc1dd tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:12.801725 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f3dd87a6-80f0-48ea-8ef1-5ad6c9ccc1dd tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:12.802153 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f3dd87a6-80f0-48ea-8ef1-5ad6c9ccc1dd tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:12.895221 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-acb96177-a978-42a0-9950-9990af5b4fa6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.327697 Nov 08 16:13:12.899081 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 219/434] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:12 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:12.900884 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1681686192", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1157858539", "security_groups": [{"name": "tempest-secgroup-smoke-706634952"}], "block_device_mapping_v2": [{"uuid": "0e05d3d6-0f1c-47f8-a3ab-4ba487169dfa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a15e051b-c130-4140-aaf2-a45ea7af5b43"}]}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:12.931340 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f3dd87a6-80f0-48ea-8ef1-5ad6c9ccc1dd tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:12.938483 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f3dd87a6-80f0-48ea-8ef1-5ad6c9ccc1dd tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 200 len: 1314 microversion: 2.1 time: 0.147059 Nov 08 16:13:12.939032 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 216/435] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:12 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:12.943169 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5b6b7ffd-e25e-4fc4-b6f8-03a10ffbbae4 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:12.943780 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5b6b7ffd-e25e-4fc4-b6f8-03a10ffbbae4 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:12.949948 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b6b7ffd-e25e-4fc4-b6f8-03a10ffbbae4 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:12.950389 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b6b7ffd-e25e-4fc4-b6f8-03a10ffbbae4 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:12.951149 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b6b7ffd-e25e-4fc4-b6f8-03a10ffbbae4 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:12.951572 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b6b7ffd-e25e-4fc4-b6f8-03a10ffbbae4 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:13.041365 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.network.neutron [None req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] validate_networks() for [('a15e051b-c130-4140-aaf2-a45ea7af5b43', None, None, None, None, None)] {{(pid=115524) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:13:13.168305 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-5b6b7ffd-e25e-4fc4-b6f8-03a10ffbbae4 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:13.175716 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5b6b7ffd-e25e-4fc4-b6f8-03a10ffbbae4 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1319 microversion: 2.1 time: 0.235650 Nov 08 16:13:13.176195 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 217/436] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:12 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:13.451106 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Flavor limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:13:13.451521 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Image limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:13:13.451985 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Flavor pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:13:13.452383 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Image pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:13:13.452783 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:13:13.461271 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:13.461729 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:13.462533 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:13.462959 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:13.478408 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Getting quotas for project 343d5ca096394f87bea0950aa3811a13. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:13:13.482218 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Getting quotas for user e81a95f368744b3eb9fd85a9c6e0c8ed and project 343d5ca096394f87bea0950aa3811a13. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:13:13.537191 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Going to run 1 instances... {{(pid=115524) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:13:13.539573 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e05d3d6-0f1c-47f8-a3ab-4ba487169dfa',volume_size=None,volume_type=None)] {{(pid=115524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:13:13.576332 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-374a7ea9-eb6a-4028-b109-baac72cfe5d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:13.577322 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-374a7ea9-eb6a-4028-b109-baac72cfe5d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:13.583967 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-374a7ea9-eb6a-4028-b109-baac72cfe5d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:13.584948 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-374a7ea9-eb6a-4028-b109-baac72cfe5d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:13.585961 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-374a7ea9-eb6a-4028-b109-baac72cfe5d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:13.586386 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-374a7ea9-eb6a-4028-b109-baac72cfe5d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:13.665819 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.768736 Nov 08 16:13:13.666476 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 220/437] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Nov 8 16:13:12 2021] POST /compute/v2.1/servers => generated 405 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 16:13:13.675878 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-18602f6a-ae9b-4b8d-81b4-8b4fa9852221 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:13.676486 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-18602f6a-ae9b-4b8d-81b4-8b4fa9852221 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:13.733227 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-18602f6a-ae9b-4b8d-81b4-8b4fa9852221 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:13.741435 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-18602f6a-ae9b-4b8d-81b4-8b4fa9852221 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1095 microversion: 2.1 time: 0.068835 Nov 08 16:13:13.742203 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 221/438] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:13 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:13.806687 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-80ebfd49-75fc-4579-aea6-8627d48c9f6c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:13.807281 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-80ebfd49-75fc-4579-aea6-8627d48c9f6c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:13.812642 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-374a7ea9-eb6a-4028-b109-baac72cfe5d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.239804 Nov 08 16:13:13.815564 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-80ebfd49-75fc-4579-aea6-8627d48c9f6c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:13.816272 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-80ebfd49-75fc-4579-aea6-8627d48c9f6c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:13.817149 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-80ebfd49-75fc-4579-aea6-8627d48c9f6c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:13.817282 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 218/439] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:13 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:13:13.817989 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-80ebfd49-75fc-4579-aea6-8627d48c9f6c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:13.907677 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-668125a2-ec00-486e-b73c-5e0cc40d86d2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:13.909549 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-668125a2-ec00-486e-b73c-5e0cc40d86d2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:13.917531 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-668125a2-ec00-486e-b73c-5e0cc40d86d2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:13.918000 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-668125a2-ec00-486e-b73c-5e0cc40d86d2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:13.918777 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-668125a2-ec00-486e-b73c-5e0cc40d86d2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:13.919196 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-668125a2-ec00-486e-b73c-5e0cc40d86d2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:13.976096 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-80ebfd49-75fc-4579-aea6-8627d48c9f6c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:13.983481 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-80ebfd49-75fc-4579-aea6-8627d48c9f6c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.180769 Nov 08 16:13:13.984052 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 222/440] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:13 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:13.988416 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-28f8301a-45ff-483d-a6b2-39cc603995a7 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:13.988915 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-28f8301a-45ff-483d-a6b2-39cc603995a7 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:13.994692 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-28f8301a-45ff-483d-a6b2-39cc603995a7 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:13.995138 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-28f8301a-45ff-483d-a6b2-39cc603995a7 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:13.995974 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-28f8301a-45ff-483d-a6b2-39cc603995a7 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:13.996435 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-28f8301a-45ff-483d-a6b2-39cc603995a7 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:14.153187 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-28f8301a-45ff-483d-a6b2-39cc603995a7 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:14.160855 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-28f8301a-45ff-483d-a6b2-39cc603995a7 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 200 len: 1314 microversion: 2.1 time: 0.175784 Nov 08 16:13:14.161435 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 223/441] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:13 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:14.171607 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-668125a2-ec00-486e-b73c-5e0cc40d86d2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.268146 Nov 08 16:13:14.172265 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 219/442] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:13 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:13:14.192213 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a7d1c9f5-bac8-4f0d-9d4c-4b88d0ca5846 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:14.192915 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a7d1c9f5-bac8-4f0d-9d4c-4b88d0ca5846 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:14.199225 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a7d1c9f5-bac8-4f0d-9d4c-4b88d0ca5846 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:14.199666 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a7d1c9f5-bac8-4f0d-9d4c-4b88d0ca5846 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:14.200428 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a7d1c9f5-bac8-4f0d-9d4c-4b88d0ca5846 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:14.200851 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a7d1c9f5-bac8-4f0d-9d4c-4b88d0ca5846 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:14.336156 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a7d1c9f5-bac8-4f0d-9d4c-4b88d0ca5846 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:14.344331 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a7d1c9f5-bac8-4f0d-9d4c-4b88d0ca5846 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1319 microversion: 2.1 time: 0.155655 Nov 08 16:13:14.345141 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 224/443] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:14 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:14.763963 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5a7f756c-42c7-43c0-b454-7fa1e620d633 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:14.764710 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5a7f756c-42c7-43c0-b454-7fa1e620d633 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:14.774585 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5a7f756c-42c7-43c0-b454-7fa1e620d633 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:14.775043 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5a7f756c-42c7-43c0-b454-7fa1e620d633 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:14.775843 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5a7f756c-42c7-43c0-b454-7fa1e620d633 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:14.776274 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5a7f756c-42c7-43c0-b454-7fa1e620d633 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:14.824806 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2a24f3f9-5bf5-47e5-a497-077f5b59f6c7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:14.825962 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2a24f3f9-5bf5-47e5-a497-077f5b59f6c7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:14.837104 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2a24f3f9-5bf5-47e5-a497-077f5b59f6c7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:14.838102 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2a24f3f9-5bf5-47e5-a497-077f5b59f6c7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:14.839252 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2a24f3f9-5bf5-47e5-a497-077f5b59f6c7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:14.839782 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2a24f3f9-5bf5-47e5-a497-077f5b59f6c7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:14.864084 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-5a7f756c-42c7-43c0-b454-7fa1e620d633 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:14.879746 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5a7f756c-42c7-43c0-b454-7fa1e620d633 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1201 microversion: 2.1 time: 0.119822 Nov 08 16:13:14.892301 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 220/444] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:14 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1201 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:14.949490 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2a24f3f9-5bf5-47e5-a497-077f5b59f6c7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.128506 Nov 08 16:13:14.950868 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 225/445] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:14 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:13:15.001157 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c313c80d-4fbc-4528-a3d7-9adc7bc61f24 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:15.001859 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c313c80d-4fbc-4528-a3d7-9adc7bc61f24 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:15.009039 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c313c80d-4fbc-4528-a3d7-9adc7bc61f24 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:15.009881 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c313c80d-4fbc-4528-a3d7-9adc7bc61f24 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:15.010776 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c313c80d-4fbc-4528-a3d7-9adc7bc61f24 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:15.011362 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c313c80d-4fbc-4528-a3d7-9adc7bc61f24 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:15.177682 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-cf39a5ec-b611-4668-8a0c-9835f002a86b tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:15.179056 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-cf39a5ec-b611-4668-8a0c-9835f002a86b tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:15.193120 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cf39a5ec-b611-4668-8a0c-9835f002a86b tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:15.193120 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cf39a5ec-b611-4668-8a0c-9835f002a86b tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:15.193120 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cf39a5ec-b611-4668-8a0c-9835f002a86b tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:15.193120 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cf39a5ec-b611-4668-8a0c-9835f002a86b tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:15.220566 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c313c80d-4fbc-4528-a3d7-9adc7bc61f24 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:15.229890 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c313c80d-4fbc-4528-a3d7-9adc7bc61f24 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.233258 Nov 08 16:13:15.238404 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 221/446] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:14 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:15.244226 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d198f769-8b85-412c-97f2-9f8e1df41564 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:15.245191 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d198f769-8b85-412c-97f2-9f8e1df41564 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:15.251286 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d198f769-8b85-412c-97f2-9f8e1df41564 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:15.251725 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d198f769-8b85-412c-97f2-9f8e1df41564 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:15.252493 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d198f769-8b85-412c-97f2-9f8e1df41564 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:15.252920 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d198f769-8b85-412c-97f2-9f8e1df41564 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:15.421453 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-cf39a5ec-b611-4668-8a0c-9835f002a86b tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:15.428781 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-cf39a5ec-b611-4668-8a0c-9835f002a86b tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 200 len: 1314 microversion: 2.1 time: 0.255141 Nov 08 16:13:15.429439 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 226/447] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:15 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:15.433720 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f62fa40f-2a82-4f11-ade5-267bd51fb977 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:15.434324 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f62fa40f-2a82-4f11-ade5-267bd51fb977 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:15.439753 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f62fa40f-2a82-4f11-ade5-267bd51fb977 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:15.440190 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f62fa40f-2a82-4f11-ade5-267bd51fb977 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:15.440951 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f62fa40f-2a82-4f11-ade5-267bd51fb977 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:15.441373 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f62fa40f-2a82-4f11-ade5-267bd51fb977 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:15.520521 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d198f769-8b85-412c-97f2-9f8e1df41564 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.280706 Nov 08 16:13:15.525243 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 222/448] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:15 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:15.643165 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f62fa40f-2a82-4f11-ade5-267bd51fb977 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:15.655967 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f62fa40f-2a82-4f11-ade5-267bd51fb977 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1319 microversion: 2.1 time: 0.224626 Nov 08 16:13:15.656614 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 227/449] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:15 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:15.900965 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f60ad004-de7e-4a93-b750-fb325b283deb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:15.902407 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f60ad004-de7e-4a93-b750-fb325b283deb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:15.910508 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f60ad004-de7e-4a93-b750-fb325b283deb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:15.910966 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f60ad004-de7e-4a93-b750-fb325b283deb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:15.911966 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f60ad004-de7e-4a93-b750-fb325b283deb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:15.913120 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f60ad004-de7e-4a93-b750-fb325b283deb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:15.961751 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-cd4fcc91-fb0b-4764-bdcc-f765b1bacf5b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:15.963662 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-cd4fcc91-fb0b-4764-bdcc-f765b1bacf5b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:15.970274 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cd4fcc91-fb0b-4764-bdcc-f765b1bacf5b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:15.970729 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cd4fcc91-fb0b-4764-bdcc-f765b1bacf5b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:15.971507 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cd4fcc91-fb0b-4764-bdcc-f765b1bacf5b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:15.972007 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cd4fcc91-fb0b-4764-bdcc-f765b1bacf5b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:16.085802 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-cd4fcc91-fb0b-4764-bdcc-f765b1bacf5b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.127242 Nov 08 16:13:16.086598 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 228/450] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:15 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:13:16.179753 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f60ad004-de7e-4a93-b750-fb325b283deb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:16.187928 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f60ad004-de7e-4a93-b750-fb325b283deb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1278 microversion: 2.1 time: 0.291540 Nov 08 16:13:16.190169 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 223/451] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:15 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1278 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:16.248894 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-74bcb082-e3c3-4bcf-bb5f-e6f729fba0b4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:16.250347 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-74bcb082-e3c3-4bcf-bb5f-e6f729fba0b4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:16.258738 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-74bcb082-e3c3-4bcf-bb5f-e6f729fba0b4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:16.259264 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-74bcb082-e3c3-4bcf-bb5f-e6f729fba0b4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:16.260122 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-74bcb082-e3c3-4bcf-bb5f-e6f729fba0b4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:16.260642 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-74bcb082-e3c3-4bcf-bb5f-e6f729fba0b4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:16.446139 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-fc642586-1d63-4492-b356-c63794896ce1 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:16.447114 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fc642586-1d63-4492-b356-c63794896ce1 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:16.455649 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fc642586-1d63-4492-b356-c63794896ce1 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:16.456199 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fc642586-1d63-4492-b356-c63794896ce1 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:16.457059 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fc642586-1d63-4492-b356-c63794896ce1 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:16.457560 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fc642586-1d63-4492-b356-c63794896ce1 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:16.522936 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-74bcb082-e3c3-4bcf-bb5f-e6f729fba0b4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:16.531057 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-74bcb082-e3c3-4bcf-bb5f-e6f729fba0b4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.287486 Nov 08 16:13:16.531721 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 229/452] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:16 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:16.536165 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-41fd0632-65ee-4dce-9de5-e176fd53d17f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:16.537201 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-41fd0632-65ee-4dce-9de5-e176fd53d17f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:16.546442 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-41fd0632-65ee-4dce-9de5-e176fd53d17f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:16.547091 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-41fd0632-65ee-4dce-9de5-e176fd53d17f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:16.548348 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-41fd0632-65ee-4dce-9de5-e176fd53d17f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:16.548781 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-41fd0632-65ee-4dce-9de5-e176fd53d17f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:16.679999 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-41fd0632-65ee-4dce-9de5-e176fd53d17f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.146926 Nov 08 16:13:16.680650 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 230/453] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:16 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:16.685754 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0c0d77b1-21f4-48aa-9ad9-44a1a716f948 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:16.686436 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0c0d77b1-21f4-48aa-9ad9-44a1a716f948 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:16.694600 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0c0d77b1-21f4-48aa-9ad9-44a1a716f948 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:16.695099 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0c0d77b1-21f4-48aa-9ad9-44a1a716f948 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:16.695804 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0c0d77b1-21f4-48aa-9ad9-44a1a716f948 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:16.696229 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0c0d77b1-21f4-48aa-9ad9-44a1a716f948 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:16.705501 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fc642586-1d63-4492-b356-c63794896ce1 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:16.715665 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-fc642586-1d63-4492-b356-c63794896ce1 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 200 len: 1314 microversion: 2.1 time: 0.273901 Nov 08 16:13:16.726041 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 224/454] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:16 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:16.734690 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-3b03a114-ea2b-45b4-ae77-1eabd22484c3 req-069d1a61-8890-4334-9fcc-73f862972c1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d643b8f8-c205-49ba-8889-30842481b95f", "tag": "17d7004d-111e-4cfc-904c-a17ed005bc2f"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:16.747109 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:13:16.747109 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:13:16.754895 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-3b03a114-ea2b-45b4-ae77-1eabd22484c3 req-069d1a61-8890-4334-9fcc-73f862972c1e service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:16.755334 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-3b03a114-ea2b-45b4-ae77-1eabd22484c3 req-069d1a61-8890-4334-9fcc-73f862972c1e service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:16.767763 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-3b03a114-ea2b-45b4-ae77-1eabd22484c3 req-069d1a61-8890-4334-9fcc-73f862972c1e service nova] Creating event network-changed:17d7004d-111e-4cfc-904c-a17ed005bc2f for instance d643b8f8-c205-49ba-8889-30842481b95f on hv-cinder-81618 Nov 08 16:13:16.774599 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-3b03a114-ea2b-45b4-ae77-1eabd22484c3 req-069d1a61-8890-4334-9fcc-73f862972c1e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043150 Nov 08 16:13:16.775586 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 225/455] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:13:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:13:16.936887 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0c0d77b1-21f4-48aa-9ad9-44a1a716f948 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:16.945784 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0c0d77b1-21f4-48aa-9ad9-44a1a716f948 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1319 microversion: 2.1 time: 0.263824 Nov 08 16:13:16.946572 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 231/456] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:16 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:17.098363 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1b51227b-0322-4023-95c5-b1376b5cf373 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:17.099469 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1b51227b-0322-4023-95c5-b1376b5cf373 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:17.106519 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1b51227b-0322-4023-95c5-b1376b5cf373 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:17.107326 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1b51227b-0322-4023-95c5-b1376b5cf373 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:17.108335 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1b51227b-0322-4023-95c5-b1376b5cf373 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:17.108966 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1b51227b-0322-4023-95c5-b1376b5cf373 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:17.205912 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-21d2b4b8-da79-4518-9aef-c44150b0fd6f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:17.206616 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-21d2b4b8-da79-4518-9aef-c44150b0fd6f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:17.213418 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-21d2b4b8-da79-4518-9aef-c44150b0fd6f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:17.213961 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-21d2b4b8-da79-4518-9aef-c44150b0fd6f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:17.214796 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-21d2b4b8-da79-4518-9aef-c44150b0fd6f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:17.215292 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-21d2b4b8-da79-4518-9aef-c44150b0fd6f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:17.230902 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1b51227b-0322-4023-95c5-b1376b5cf373 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.137052 Nov 08 16:13:17.231660 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 226/457] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:17 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:17.404085 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-21d2b4b8-da79-4518-9aef-c44150b0fd6f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:17.411719 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-21d2b4b8-da79-4518-9aef-c44150b0fd6f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1278 microversion: 2.1 time: 0.209577 Nov 08 16:13:17.413023 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 232/458] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:17 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1278 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:17.548316 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9317adb9-5c2d-4633-9827-dc5e2ee747cf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:17.549209 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-9317adb9-5c2d-4633-9827-dc5e2ee747cf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:17.556208 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9317adb9-5c2d-4633-9827-dc5e2ee747cf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:17.556890 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9317adb9-5c2d-4633-9827-dc5e2ee747cf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:17.557927 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9317adb9-5c2d-4633-9827-dc5e2ee747cf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:17.558584 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9317adb9-5c2d-4633-9827-dc5e2ee747cf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:17.694809 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e8b3e6ce-d468-42b1-a375-232cd997552b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:17.696807 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e8b3e6ce-d468-42b1-a375-232cd997552b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:17.706392 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e8b3e6ce-d468-42b1-a375-232cd997552b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:17.706755 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e8b3e6ce-d468-42b1-a375-232cd997552b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:17.707786 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e8b3e6ce-d468-42b1-a375-232cd997552b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:17.708216 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e8b3e6ce-d468-42b1-a375-232cd997552b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:17.797352 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e8b3e6ce-d468-42b1-a375-232cd997552b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.108377 Nov 08 16:13:17.798692 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 233/459] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:17 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:17.798910 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-9317adb9-5c2d-4633-9827-dc5e2ee747cf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:17.803052 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-77427e00-a7ed-4be3-a052-a210b39fc800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:17.803744 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-77427e00-a7ed-4be3-a052-a210b39fc800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:17.805749 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-9317adb9-5c2d-4633-9827-dc5e2ee747cf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1500 microversion: 2.1 time: 0.261763 Nov 08 16:13:17.806312 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 227/460] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:17 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1500 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:17.810770 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-77427e00-a7ed-4be3-a052-a210b39fc800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:17.811247 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-77427e00-a7ed-4be3-a052-a210b39fc800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:17.811974 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-77427e00-a7ed-4be3-a052-a210b39fc800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:17.812407 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-77427e00-a7ed-4be3-a052-a210b39fc800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:17.824137 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9a1bee74-f403-48fb-978d-9d5fc909898e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "714b2943-36b7-46f9-ad01-00c38ef54a4e"}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:17.825446 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-9a1bee74-f403-48fb-978d-9d5fc909898e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:17.831508 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9a1bee74-f403-48fb-978d-9d5fc909898e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:17.832121 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9a1bee74-f403-48fb-978d-9d5fc909898e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:17.832928 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9a1bee74-f403-48fb-978d-9d5fc909898e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:17.833361 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9a1bee74-f403-48fb-978d-9d5fc909898e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:17.857967 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-9a1bee74-f403-48fb-978d-9d5fc909898e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] HTTP exception thrown: Cannot 'attach_volume' instance 44f7e3a8-0064-42ad-9e41-03a1ba050703 while it is in vm_state rescued Nov 08 16:13:17.858554 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9a1bee74-f403-48fb-978d-9d5fc909898e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Returning 409 to user: Cannot 'attach_volume' instance 44f7e3a8-0064-42ad-9e41-03a1ba050703 while it is in vm_state rescued {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:13:17.859378 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-9a1bee74-f403-48fb-978d-9d5fc909898e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "POST /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040881 Nov 08 16:13:17.859922 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 228/461] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Nov 8 16:13:17 2021] POST /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 08 16:13:17.868428 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5b94e3f6-6eea-4af2-9d6a-bb070fc5dbdf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:17.868949 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5b94e3f6-6eea-4af2-9d6a-bb070fc5dbdf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:17.877300 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b94e3f6-6eea-4af2-9d6a-bb070fc5dbdf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:17.877762 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b94e3f6-6eea-4af2-9d6a-bb070fc5dbdf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:17.878574 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b94e3f6-6eea-4af2-9d6a-bb070fc5dbdf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:17.879024 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b94e3f6-6eea-4af2-9d6a-bb070fc5dbdf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:17.953005 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5b94e3f6-6eea-4af2-9d6a-bb070fc5dbdf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "POST /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/action" status: 202 len: 0 microversion: 2.1 time: 0.087968 Nov 08 16:13:17.954855 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 229/462] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:17 2021] POST /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:13:17.962807 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5ff3a0b8-1310-4d8f-b565-3b75cb8af3dc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:17.963551 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5ff3a0b8-1310-4d8f-b565-3b75cb8af3dc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:17.969785 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5ff3a0b8-1310-4d8f-b565-3b75cb8af3dc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:17.970232 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5ff3a0b8-1310-4d8f-b565-3b75cb8af3dc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:17.971029 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5ff3a0b8-1310-4d8f-b565-3b75cb8af3dc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:17.971474 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5ff3a0b8-1310-4d8f-b565-3b75cb8af3dc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:18.094123 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-77427e00-a7ed-4be3-a052-a210b39fc800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:18.104823 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-77427e00-a7ed-4be3-a052-a210b39fc800 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 200 len: 1314 microversion: 2.1 time: 0.305595 Nov 08 16:13:18.109724 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 234/463] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:17 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:18.121420 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0f571975-aa73-4a20-a1c3-cce280fa3573 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:18.122377 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0f571975-aa73-4a20-a1c3-cce280fa3573 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:18.128740 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0f571975-aa73-4a20-a1c3-cce280fa3573 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:18.129458 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0f571975-aa73-4a20-a1c3-cce280fa3573 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:18.130809 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0f571975-aa73-4a20-a1c3-cce280fa3573 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:18.132246 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0f571975-aa73-4a20-a1c3-cce280fa3573 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:18.232133 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-5ff3a0b8-1310-4d8f-b565-3b75cb8af3dc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:18.242729 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5ff3a0b8-1310-4d8f-b565-3b75cb8af3dc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1508 microversion: 2.1 time: 0.284206 Nov 08 16:13:18.243302 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 230/464] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:17 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1508 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:18.248715 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6fbee39c-11d5-445f-b511-023e6e424849 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:18.249619 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6fbee39c-11d5-445f-b511-023e6e424849 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:18.255844 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6fbee39c-11d5-445f-b511-023e6e424849 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:18.256481 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6fbee39c-11d5-445f-b511-023e6e424849 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:18.257503 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6fbee39c-11d5-445f-b511-023e6e424849 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:18.257957 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6fbee39c-11d5-445f-b511-023e6e424849 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:18.315069 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0f571975-aa73-4a20-a1c3-cce280fa3573 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:18.324084 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0f571975-aa73-4a20-a1c3-cce280fa3573 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1319 microversion: 2.1 time: 0.212814 Nov 08 16:13:18.324664 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 235/465] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:18 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:18.359456 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6fbee39c-11d5-445f-b511-023e6e424849 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.114509 Nov 08 16:13:18.361417 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 231/466] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:18 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:18.431860 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ae02aaae-c7c9-4607-900d-65194ebbc7db tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:18.432474 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ae02aaae-c7c9-4607-900d-65194ebbc7db tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:18.438860 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ae02aaae-c7c9-4607-900d-65194ebbc7db tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:18.439305 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ae02aaae-c7c9-4607-900d-65194ebbc7db tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:18.440080 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ae02aaae-c7c9-4607-900d-65194ebbc7db tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:18.440512 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ae02aaae-c7c9-4607-900d-65194ebbc7db tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:18.445971 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9329b5b4-f6df-4c72-947f-4418d56c63fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a71de45-abe6-4df0-b3f7-ef822497b72b"}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:18.446644 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-9329b5b4-f6df-4c72-947f-4418d56c63fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:18.453476 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9329b5b4-f6df-4c72-947f-4418d56c63fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:18.453958 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9329b5b4-f6df-4c72-947f-4418d56c63fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:18.454729 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9329b5b4-f6df-4c72-947f-4418d56c63fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:18.455273 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9329b5b4-f6df-4c72-947f-4418d56c63fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:18.542578 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-9329b5b4-f6df-4c72-947f-4418d56c63fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] HTTP exception thrown: Invalid volume: volume 8a71de45-abe6-4df0-b3f7-ef822497b72b is already attached to instances: 1400ac35-c2ae-4814-ac9b-d18094175dce Nov 08 16:13:18.543416 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9329b5b4-f6df-4c72-947f-4418d56c63fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Returning 400 to user: Invalid volume: volume 8a71de45-abe6-4df0-b3f7-ef822497b72b is already attached to instances: 1400ac35-c2ae-4814-ac9b-d18094175dce {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:13:18.544417 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-9329b5b4-f6df-4c72-947f-4418d56c63fc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "POST /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104078 Nov 08 16:13:18.545252 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 232/467] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Nov 8 16:13:18 2021] POST /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 08 16:13:18.581582 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-ae02aaae-c7c9-4607-900d-65194ebbc7db tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:18.593919 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ae02aaae-c7c9-4607-900d-65194ebbc7db tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1266 microversion: 2.1 time: 0.165593 Nov 08 16:13:18.593919 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 236/468] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:18 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:18.604751 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-615490fd-5008-4083-951b-ec8d117575ce tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:18.605234 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-615490fd-5008-4083-951b-ec8d117575ce tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:18.612012 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-615490fd-5008-4083-951b-ec8d117575ce tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:18.612466 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-615490fd-5008-4083-951b-ec8d117575ce tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:18.613232 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-615490fd-5008-4083-951b-ec8d117575ce tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:18.613658 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-615490fd-5008-4083-951b-ec8d117575ce tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:18.734141 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.objects.instance [None req-615490fd-5008-4083-951b-ec8d117575ce tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lazy-loading 'services' on Instance uuid 1400ac35-c2ae-4814-ac9b-d18094175dce {{(pid=115523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:13:18.809059 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-232f1084-9811-45be-9a42-ed05e898b24e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:18.810068 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-232f1084-9811-45be-9a42-ed05e898b24e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:18.817262 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-232f1084-9811-45be-9a42-ed05e898b24e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:18.817993 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-232f1084-9811-45be-9a42-ed05e898b24e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:18.819625 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-232f1084-9811-45be-9a42-ed05e898b24e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:18.820182 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-232f1084-9811-45be-9a42-ed05e898b24e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:18.846725 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-615490fd-5008-4083-951b-ec8d117575ce tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "DELETE /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce/os-volume_attachments/8a71de45-abe6-4df0-b3f7-ef822497b72b" status: 202 len: 0 microversion: 2.1 time: 0.245449 Nov 08 16:13:18.847376 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 233/469] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Nov 8 16:13:18 2021] DELETE /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce/os-volume_attachments/8a71de45-abe6-4df0-b3f7-ef822497b72b => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:18.855749 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-73e427a4-d6c7-49eb-90c7-657c5777185c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:18.856742 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-73e427a4-d6c7-49eb-90c7-657c5777185c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:18.864447 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-73e427a4-d6c7-49eb-90c7-657c5777185c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:18.864890 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-73e427a4-d6c7-49eb-90c7-657c5777185c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:18.866237 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-73e427a4-d6c7-49eb-90c7-657c5777185c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:18.866709 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-73e427a4-d6c7-49eb-90c7-657c5777185c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:18.896858 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-73e427a4-d6c7-49eb-90c7-657c5777185c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044951 Nov 08 16:13:18.897407 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 234/470] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:13:18 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:13:19.126655 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d06cc4e3-ca12-4fd9-82a1-17321f0f2758 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:19.127255 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d06cc4e3-ca12-4fd9-82a1-17321f0f2758 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:19.133460 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d06cc4e3-ca12-4fd9-82a1-17321f0f2758 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:19.133940 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d06cc4e3-ca12-4fd9-82a1-17321f0f2758 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:19.134699 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d06cc4e3-ca12-4fd9-82a1-17321f0f2758 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:19.135120 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d06cc4e3-ca12-4fd9-82a1-17321f0f2758 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:19.181262 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-232f1084-9811-45be-9a42-ed05e898b24e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.375545 Nov 08 16:13:19.181941 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 237/471] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:18 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:19.261090 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ea2b38e7-51c3-4bf1-9b23-4b56f691f744 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:19.261816 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ea2b38e7-51c3-4bf1-9b23-4b56f691f744 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:19.268505 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ea2b38e7-51c3-4bf1-9b23-4b56f691f744 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:19.268953 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ea2b38e7-51c3-4bf1-9b23-4b56f691f744 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:19.269735 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ea2b38e7-51c3-4bf1-9b23-4b56f691f744 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:19.270186 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ea2b38e7-51c3-4bf1-9b23-4b56f691f744 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:19.270559 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d06cc4e3-ca12-4fd9-82a1-17321f0f2758 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:19.278470 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d06cc4e3-ca12-4fd9-82a1-17321f0f2758 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 200 len: 1314 microversion: 2.1 time: 0.155637 Nov 08 16:13:19.279023 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 235/472] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:19 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:19.341992 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-dcaedc0c-ab28-4fd5-8331-876edcf06566 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:19.342853 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-dcaedc0c-ab28-4fd5-8331-876edcf06566 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:19.349585 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dcaedc0c-ab28-4fd5-8331-876edcf06566 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:19.350064 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dcaedc0c-ab28-4fd5-8331-876edcf06566 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:19.350867 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dcaedc0c-ab28-4fd5-8331-876edcf06566 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:19.351296 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dcaedc0c-ab28-4fd5-8331-876edcf06566 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:19.429704 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-ea2b38e7-51c3-4bf1-9b23-4b56f691f744 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:19.436887 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ea2b38e7-51c3-4bf1-9b23-4b56f691f744 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1508 microversion: 2.1 time: 0.179797 Nov 08 16:13:19.437446 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 238/473] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:19 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:19.441798 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-97186f48-d572-4b19-8048-dedfb9268af0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:19.442739 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-97186f48-d572-4b19-8048-dedfb9268af0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:19.448992 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-97186f48-d572-4b19-8048-dedfb9268af0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:19.449440 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-97186f48-d572-4b19-8048-dedfb9268af0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:19.450247 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-97186f48-d572-4b19-8048-dedfb9268af0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:19.450676 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-97186f48-d572-4b19-8048-dedfb9268af0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:19.590041 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-97186f48-d572-4b19-8048-dedfb9268af0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.151244 Nov 08 16:13:19.590695 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 239/474] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:19 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:19.607653 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-81ba0e52-ae0d-45cf-ac5f-820570e9c731 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:19.608285 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-81ba0e52-ae0d-45cf-ac5f-820570e9c731 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:19.615953 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-81ba0e52-ae0d-45cf-ac5f-820570e9c731 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:19.616397 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-81ba0e52-ae0d-45cf-ac5f-820570e9c731 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:19.617183 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-81ba0e52-ae0d-45cf-ac5f-820570e9c731 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:19.617613 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-81ba0e52-ae0d-45cf-ac5f-820570e9c731 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:19.712979 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-dcaedc0c-ab28-4fd5-8331-876edcf06566 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:19.720492 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-dcaedc0c-ab28-4fd5-8331-876edcf06566 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1319 microversion: 2.1 time: 0.382705 Nov 08 16:13:19.721044 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 236/475] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:19 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:19.797389 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-81ba0e52-ae0d-45cf-ac5f-820570e9c731 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:19.805838 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-81ba0e52-ae0d-45cf-ac5f-820570e9c731 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1266 microversion: 2.1 time: 0.202311 Nov 08 16:13:19.806392 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 240/476] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:19 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:19.908502 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-481d317f-a36c-4ba5-9fac-1d3a86e817f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:19.909377 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-481d317f-a36c-4ba5-9fac-1d3a86e817f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:19.916007 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-481d317f-a36c-4ba5-9fac-1d3a86e817f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:19.916654 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-481d317f-a36c-4ba5-9fac-1d3a86e817f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:19.917417 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-481d317f-a36c-4ba5-9fac-1d3a86e817f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:19.918142 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-481d317f-a36c-4ba5-9fac-1d3a86e817f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:19.947007 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-658d8875-162b-43c5-bacd-0dfe5b89d40a req-d13b64f9-b8ec-40b4-9985-17fe7054cd95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be55525-c510-4909-a898-370d4760deea", "name": "network-vif-plugged", "status": "completed", "tag": "00b6d387-6249-49c0-81db-f2b5b8a1ce31"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:19.948694 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-481d317f-a36c-4ba5-9fac-1d3a86e817f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044082 Nov 08 16:13:19.949426 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 237/477] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:13:19 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:13:19.950002 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:13:19.950002 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:13:19.959903 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-658d8875-162b-43c5-bacd-0dfe5b89d40a req-d13b64f9-b8ec-40b4-9985-17fe7054cd95 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:19.960563 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-658d8875-162b-43c5-bacd-0dfe5b89d40a req-d13b64f9-b8ec-40b4-9985-17fe7054cd95 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:19.975300 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-658d8875-162b-43c5-bacd-0dfe5b89d40a req-d13b64f9-b8ec-40b4-9985-17fe7054cd95 service nova] Creating event network-vif-plugged:00b6d387-6249-49c0-81db-f2b5b8a1ce31 for instance 2be55525-c510-4909-a898-370d4760deea on hv-cinder-81618 Nov 08 16:13:19.981147 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-658d8875-162b-43c5-bacd-0dfe5b89d40a req-d13b64f9-b8ec-40b4-9985-17fe7054cd95 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038035 Nov 08 16:13:19.982066 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 241/478] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:13:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:13:20.192269 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4984c2b0-01a6-439a-83f3-a74bdec275b1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:20.193769 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4984c2b0-01a6-439a-83f3-a74bdec275b1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:20.200209 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4984c2b0-01a6-439a-83f3-a74bdec275b1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:20.201346 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4984c2b0-01a6-439a-83f3-a74bdec275b1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:20.202556 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4984c2b0-01a6-439a-83f3-a74bdec275b1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:20.203393 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4984c2b0-01a6-439a-83f3-a74bdec275b1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:20.296055 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-536a1bcd-fab1-4d83-9c3d-3138e4a421f8 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:20.296771 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-536a1bcd-fab1-4d83-9c3d-3138e4a421f8 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:20.302729 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-536a1bcd-fab1-4d83-9c3d-3138e4a421f8 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:20.303175 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-536a1bcd-fab1-4d83-9c3d-3138e4a421f8 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:20.303950 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-536a1bcd-fab1-4d83-9c3d-3138e4a421f8 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:20.304383 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-536a1bcd-fab1-4d83-9c3d-3138e4a421f8 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:20.431049 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-536a1bcd-fab1-4d83-9c3d-3138e4a421f8 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:20.438334 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-536a1bcd-fab1-4d83-9c3d-3138e4a421f8 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 200 len: 1314 microversion: 2.1 time: 0.146752 Nov 08 16:13:20.438913 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 242/479] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:20 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:20.453886 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4f00f000-3197-4d53-9538-7653b7663a1b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:20.454483 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4f00f000-3197-4d53-9538-7653b7663a1b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:20.460626 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4f00f000-3197-4d53-9538-7653b7663a1b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:20.461068 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4f00f000-3197-4d53-9538-7653b7663a1b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:20.461851 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4f00f000-3197-4d53-9538-7653b7663a1b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:20.462281 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4f00f000-3197-4d53-9538-7653b7663a1b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:20.590605 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4f00f000-3197-4d53-9538-7653b7663a1b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:20.597646 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4f00f000-3197-4d53-9538-7653b7663a1b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1508 microversion: 2.1 time: 0.147166 Nov 08 16:13:20.598229 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 243/480] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:20 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:20.602474 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d6505dce-758b-4f1d-b648-84ccf9387e00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:20.603415 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d6505dce-758b-4f1d-b648-84ccf9387e00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:20.608801 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d6505dce-758b-4f1d-b648-84ccf9387e00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:20.609237 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d6505dce-758b-4f1d-b648-84ccf9387e00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:20.610023 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d6505dce-758b-4f1d-b648-84ccf9387e00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:20.610449 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d6505dce-758b-4f1d-b648-84ccf9387e00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:20.616160 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4984c2b0-01a6-439a-83f3-a74bdec275b1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.427412 Nov 08 16:13:20.620122 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 238/481] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:20 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:20.736713 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f7ea033a-9143-435d-9ff7-b0eaa9ea9efc tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:20.737317 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f7ea033a-9143-435d-9ff7-b0eaa9ea9efc tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:20.744154 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f7ea033a-9143-435d-9ff7-b0eaa9ea9efc tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:20.744600 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f7ea033a-9143-435d-9ff7-b0eaa9ea9efc tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:20.745365 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f7ea033a-9143-435d-9ff7-b0eaa9ea9efc tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:20.745824 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f7ea033a-9143-435d-9ff7-b0eaa9ea9efc tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:20.777120 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d6505dce-758b-4f1d-b648-84ccf9387e00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.177647 Nov 08 16:13:20.777784 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 244/482] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:20 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:20.823685 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-6dea3970-4e0d-4085-b281-b5630c10116a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:20.824433 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-6dea3970-4e0d-4085-b281-b5630c10116a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:20.831517 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6dea3970-4e0d-4085-b281-b5630c10116a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:20.832035 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6dea3970-4e0d-4085-b281-b5630c10116a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:20.832883 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6dea3970-4e0d-4085-b281-b5630c10116a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:20.833386 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6dea3970-4e0d-4085-b281-b5630c10116a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:20.885636 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f7ea033a-9143-435d-9ff7-b0eaa9ea9efc tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:20.892977 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f7ea033a-9143-435d-9ff7-b0eaa9ea9efc tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1319 microversion: 2.1 time: 0.160387 Nov 08 16:13:20.893615 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 239/483] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:20 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:20.960385 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c0c1f682-5c6b-474b-99a2-db6a8209d76a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:20.961290 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c0c1f682-5c6b-474b-99a2-db6a8209d76a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:20.967054 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c0c1f682-5c6b-474b-99a2-db6a8209d76a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:20.967491 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c0c1f682-5c6b-474b-99a2-db6a8209d76a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:20.968277 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c0c1f682-5c6b-474b-99a2-db6a8209d76a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:20.968685 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c0c1f682-5c6b-474b-99a2-db6a8209d76a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:20.972569 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-6dea3970-4e0d-4085-b281-b5630c10116a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:20.980425 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-6dea3970-4e0d-4085-b281-b5630c10116a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1266 microversion: 2.1 time: 0.162039 Nov 08 16:13:20.981531 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 245/484] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:20 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:20.998531 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c0c1f682-5c6b-474b-99a2-db6a8209d76a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042043 Nov 08 16:13:20.999010 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 240/485] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:13:20 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:13:21.454713 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-cf71da23-856a-40f7-9066-43f44aac047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:21.455328 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-cf71da23-856a-40f7-9066-43f44aac047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:21.462203 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cf71da23-856a-40f7-9066-43f44aac047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:21.462650 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cf71da23-856a-40f7-9066-43f44aac047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:21.463414 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cf71da23-856a-40f7-9066-43f44aac047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:21.463852 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cf71da23-856a-40f7-9066-43f44aac047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:21.595247 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-cf71da23-856a-40f7-9066-43f44aac047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:21.602629 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-cf71da23-856a-40f7-9066-43f44aac047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 200 len: 1314 microversion: 2.1 time: 0.151585 Nov 08 16:13:21.603391 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 246/486] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:21 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:21.617334 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-26263f50-164a-4024-b9e7-b3d010416e21 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:21.618228 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-26263f50-164a-4024-b9e7-b3d010416e21 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:21.625797 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-26263f50-164a-4024-b9e7-b3d010416e21 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:21.626168 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-26263f50-164a-4024-b9e7-b3d010416e21 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:21.626937 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-26263f50-164a-4024-b9e7-b3d010416e21 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:21.627540 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-26263f50-164a-4024-b9e7-b3d010416e21 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:21.628041 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-323c9144-f6f6-4932-8cbb-d0059f0f6c9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:21.629294 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-323c9144-f6f6-4932-8cbb-d0059f0f6c9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:21.636038 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-323c9144-f6f6-4932-8cbb-d0059f0f6c9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:21.636447 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-323c9144-f6f6-4932-8cbb-d0059f0f6c9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:21.637232 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-323c9144-f6f6-4932-8cbb-d0059f0f6c9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:21.637670 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-323c9144-f6f6-4932-8cbb-d0059f0f6c9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:21.758434 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-26263f50-164a-4024-b9e7-b3d010416e21 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:21.765569 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-26263f50-164a-4024-b9e7-b3d010416e21 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1508 microversion: 2.1 time: 0.151946 Nov 08 16:13:21.766160 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 241/487] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:21 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:21.788071 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b8faf1a6-cdde-4da1-8576-8af9e23165a1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:21.789029 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b8faf1a6-cdde-4da1-8576-8af9e23165a1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:21.794682 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b8faf1a6-cdde-4da1-8576-8af9e23165a1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:21.795115 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b8faf1a6-cdde-4da1-8576-8af9e23165a1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:21.795867 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b8faf1a6-cdde-4da1-8576-8af9e23165a1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:21.796283 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b8faf1a6-cdde-4da1-8576-8af9e23165a1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:21.807958 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-323c9144-f6f6-4932-8cbb-d0059f0f6c9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.183887 Nov 08 16:13:21.811845 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 247/488] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:21 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:13:21.909975 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bca65e49-7a53-4dbc-b73f-2ce61451ce00 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:21.910581 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-bca65e49-7a53-4dbc-b73f-2ce61451ce00 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:21.917841 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bca65e49-7a53-4dbc-b73f-2ce61451ce00 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:21.918296 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bca65e49-7a53-4dbc-b73f-2ce61451ce00 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:21.919076 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bca65e49-7a53-4dbc-b73f-2ce61451ce00 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:21.919512 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bca65e49-7a53-4dbc-b73f-2ce61451ce00 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:21.982206 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b8faf1a6-cdde-4da1-8576-8af9e23165a1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.197359 Nov 08 16:13:21.983703 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 242/489] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:21 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:13:21.997523 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d1dd8db1-f5f8-46fb-8c2b-86d998461ad5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:21.998588 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d1dd8db1-f5f8-46fb-8c2b-86d998461ad5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:22.012826 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d1dd8db1-f5f8-46fb-8c2b-86d998461ad5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:22.013376 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d1dd8db1-f5f8-46fb-8c2b-86d998461ad5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:22.014352 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d1dd8db1-f5f8-46fb-8c2b-86d998461ad5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:22.014840 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d1dd8db1-f5f8-46fb-8c2b-86d998461ad5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:22.065347 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-bca65e49-7a53-4dbc-b73f-2ce61451ce00 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:22.073230 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bca65e49-7a53-4dbc-b73f-2ce61451ce00 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1319 microversion: 2.1 time: 0.167437 Nov 08 16:13:22.073815 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 248/490] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:21 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:22.087598 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-9c45b4b9-81e6-4c9f-9902-1f38a50cb148 req-fa6e5d83-1711-44f5-a0f9-73c227226655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e41a90ba-f4f1-472e-9883-150d31bcc777", "name": "network-vif-plugged", "status": "completed", "tag": "69152346-0cf4-4b0a-9db9-f1bddb32dc4b"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:22.087598 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:13:22.087598 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:13:22.087598 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-9c45b4b9-81e6-4c9f-9902-1f38a50cb148 req-fa6e5d83-1711-44f5-a0f9-73c227226655 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:22.087923 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-9c45b4b9-81e6-4c9f-9902-1f38a50cb148 req-fa6e5d83-1711-44f5-a0f9-73c227226655 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:22.098559 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-9c45b4b9-81e6-4c9f-9902-1f38a50cb148 req-fa6e5d83-1711-44f5-a0f9-73c227226655 service nova] Creating event network-vif-plugged:69152346-0cf4-4b0a-9db9-f1bddb32dc4b for instance e41a90ba-f4f1-472e-9883-150d31bcc777 on hv-cinder-81618 Nov 08 16:13:22.103788 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-9c45b4b9-81e6-4c9f-9902-1f38a50cb148 req-fa6e5d83-1711-44f5-a0f9-73c227226655 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028806 Nov 08 16:13:22.104367 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 249/491] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:13:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:13:22.110127 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-24427fe6-b189-48af-8145-a41b68da32f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:22.110391 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-24427fe6-b189-48af-8145-a41b68da32f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:22.117630 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-24427fe6-b189-48af-8145-a41b68da32f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:22.118105 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-24427fe6-b189-48af-8145-a41b68da32f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:22.118917 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-24427fe6-b189-48af-8145-a41b68da32f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:22.119634 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-24427fe6-b189-48af-8145-a41b68da32f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:22.151313 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-24427fe6-b189-48af-8145-a41b68da32f4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045667 Nov 08 16:13:22.152096 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 250/492] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:13:22 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:13:22.156598 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d1dd8db1-f5f8-46fb-8c2b-86d998461ad5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:22.165197 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d1dd8db1-f5f8-46fb-8c2b-86d998461ad5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1266 microversion: 2.1 time: 0.172091 Nov 08 16:13:22.166672 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 243/493] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:21 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:22.296029 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-43019220-cbe5-46ba-90db-518f6e7afbc4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1469855469", "imageRef": "9abeafba-e602-4e0a-aab2-62160562de06", "flavorRef": "452", "networks": [{"uuid": "f70ee550-62a6-48db-bca5-a0b964bbcce9"}]}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:22.349156 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.network.neutron [None req-43019220-cbe5-46ba-90db-518f6e7afbc4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] validate_networks() for [('f70ee550-62a6-48db-bca5-a0b964bbcce9', None, None, None, None, None)] {{(pid=115524) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:13:22.620640 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-05bb08f9-1d16-4523-b5ee-40d373ad11a0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:22.621372 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-05bb08f9-1d16-4523-b5ee-40d373ad11a0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:22.627828 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-05bb08f9-1d16-4523-b5ee-40d373ad11a0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:22.628338 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-05bb08f9-1d16-4523-b5ee-40d373ad11a0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:22.629171 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-05bb08f9-1d16-4523-b5ee-40d373ad11a0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:22.629667 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-05bb08f9-1d16-4523-b5ee-40d373ad11a0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:22.762053 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-43019220-cbe5-46ba-90db-518f6e7afbc4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Flavor limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:13:22.762535 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-43019220-cbe5-46ba-90db-518f6e7afbc4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Image limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:13:22.763079 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-43019220-cbe5-46ba-90db-518f6e7afbc4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Flavor pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:13:22.763578 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-43019220-cbe5-46ba-90db-518f6e7afbc4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Image pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:13:22.764160 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-43019220-cbe5-46ba-90db-518f6e7afbc4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:13:22.772752 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-43019220-cbe5-46ba-90db-518f6e7afbc4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:22.773188 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-43019220-cbe5-46ba-90db-518f6e7afbc4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:22.774042 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-43019220-cbe5-46ba-90db-518f6e7afbc4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:22.774465 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-43019220-cbe5-46ba-90db-518f6e7afbc4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:22.790843 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-43019220-cbe5-46ba-90db-518f6e7afbc4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Getting quotas for project 549e9715f7424ff5b3b252f354adafe9. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:13:22.794769 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-43019220-cbe5-46ba-90db-518f6e7afbc4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Getting quotas for user fc7bdbcc6f4845d590103ec01173c2cb and project 549e9715f7424ff5b3b252f354adafe9. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:13:22.805496 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-43019220-cbe5-46ba-90db-518f6e7afbc4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Going to run 1 instances... {{(pid=115524) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:13:22.807898 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-43019220-cbe5-46ba-90db-518f6e7afbc4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9abeafba-e602-4e0a-aab2-62160562de06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:13:22.808738 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-05bb08f9-1d16-4523-b5ee-40d373ad11a0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:22.817099 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-05bb08f9-1d16-4523-b5ee-40d373ad11a0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 200 len: 1314 microversion: 2.1 time: 0.200003 Nov 08 16:13:22.817961 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 244/494] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:22 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:22.823036 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5efc5edf-47a8-432d-a836-95eb007f1943 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:22.823628 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5efc5edf-47a8-432d-a836-95eb007f1943 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:22.829205 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5efc5edf-47a8-432d-a836-95eb007f1943 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:22.829645 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5efc5edf-47a8-432d-a836-95eb007f1943 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:22.830449 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5efc5edf-47a8-432d-a836-95eb007f1943 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:22.830878 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5efc5edf-47a8-432d-a836-95eb007f1943 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:22.861625 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-43019220-cbe5-46ba-90db-518f6e7afbc4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569239 Nov 08 16:13:22.862316 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 251/495] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Nov 8 16:13:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 16:13:22.867464 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9f4944f7-1908-46ef-aa98-96bec4bad4c1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:22.868493 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9f4944f7-1908-46ef-aa98-96bec4bad4c1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:22.874660 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9f4944f7-1908-46ef-aa98-96bec4bad4c1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:22.875108 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9f4944f7-1908-46ef-aa98-96bec4bad4c1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:22.875912 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9f4944f7-1908-46ef-aa98-96bec4bad4c1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:22.876345 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9f4944f7-1908-46ef-aa98-96bec4bad4c1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:22.969217 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-5efc5edf-47a8-432d-a836-95eb007f1943 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:22.983691 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9f4944f7-1908-46ef-aa98-96bec4bad4c1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.120160 Nov 08 16:13:22.985058 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 252/496] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:22 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:22.992256 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b1d51e85-9dd3-4c36-8f16-f91f56f4225e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:22.992969 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5efc5edf-47a8-432d-a836-95eb007f1943 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1508 microversion: 2.1 time: 0.170086 Nov 08 16:13:22.993121 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b1d51e85-9dd3-4c36-8f16-f91f56f4225e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:22.993812 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 245/497] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:22 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:23.005347 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-04025db3-be65-40e9-9b3a-7326a110b548 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:23.007012 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-04025db3-be65-40e9-9b3a-7326a110b548 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:23.016735 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-04025db3-be65-40e9-9b3a-7326a110b548 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:23.017172 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-04025db3-be65-40e9-9b3a-7326a110b548 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:23.017978 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-04025db3-be65-40e9-9b3a-7326a110b548 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:23.018400 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-04025db3-be65-40e9-9b3a-7326a110b548 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:23.063749 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b1d51e85-9dd3-4c36-8f16-f91f56f4225e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:23.070790 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b1d51e85-9dd3-4c36-8f16-f91f56f4225e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1218 microversion: 2.1 time: 0.085066 Nov 08 16:13:23.076962 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 253/498] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:22 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:23.090551 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f3ec56a2-2a09-46ef-a059-e217af2b5d7f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:23.091196 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f3ec56a2-2a09-46ef-a059-e217af2b5d7f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:23.097655 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f3ec56a2-2a09-46ef-a059-e217af2b5d7f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:23.098137 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f3ec56a2-2a09-46ef-a059-e217af2b5d7f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:23.098914 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f3ec56a2-2a09-46ef-a059-e217af2b5d7f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:23.099386 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f3ec56a2-2a09-46ef-a059-e217af2b5d7f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:23.113624 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-04025db3-be65-40e9-9b3a-7326a110b548 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.118525 Nov 08 16:13:23.114475 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 246/499] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:22 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:23.183802 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9d027fcb-b4a0-45ff-96cd-4fc407f7cd00 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:23.184633 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-9d027fcb-b4a0-45ff-96cd-4fc407f7cd00 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:23.192062 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9d027fcb-b4a0-45ff-96cd-4fc407f7cd00 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:23.192570 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9d027fcb-b4a0-45ff-96cd-4fc407f7cd00 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:23.193489 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9d027fcb-b4a0-45ff-96cd-4fc407f7cd00 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:23.194000 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9d027fcb-b4a0-45ff-96cd-4fc407f7cd00 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:23.250933 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f3ec56a2-2a09-46ef-a059-e217af2b5d7f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:23.258721 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f3ec56a2-2a09-46ef-a059-e217af2b5d7f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1319 microversion: 2.1 time: 0.171864 Nov 08 16:13:23.259220 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 254/500] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:23 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:23.338873 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-9d027fcb-b4a0-45ff-96cd-4fc407f7cd00 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:23.346029 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-9d027fcb-b4a0-45ff-96cd-4fc407f7cd00 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1266 microversion: 2.1 time: 0.166420 Nov 08 16:13:23.346938 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 247/501] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:23 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:23.834175 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c58216e2-55e9-492e-bfa3-f000a9570d97 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:23.834705 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c58216e2-55e9-492e-bfa3-f000a9570d97 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:23.840819 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c58216e2-55e9-492e-bfa3-f000a9570d97 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:23.841261 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c58216e2-55e9-492e-bfa3-f000a9570d97 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:23.842046 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c58216e2-55e9-492e-bfa3-f000a9570d97 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:23.842471 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c58216e2-55e9-492e-bfa3-f000a9570d97 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:23.971578 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c58216e2-55e9-492e-bfa3-f000a9570d97 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:23.979310 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c58216e2-55e9-492e-bfa3-f000a9570d97 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 200 len: 1498 microversion: 2.1 time: 0.148917 Nov 08 16:13:23.979866 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 255/502] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:23 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:23.995497 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f83fa5bf-c9ff-414b-8c0c-1f3b08c82984 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:23.996365 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f83fa5bf-c9ff-414b-8c0c-1f3b08c82984 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:24.003075 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f83fa5bf-c9ff-414b-8c0c-1f3b08c82984 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:24.003523 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f83fa5bf-c9ff-414b-8c0c-1f3b08c82984 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:24.004293 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f83fa5bf-c9ff-414b-8c0c-1f3b08c82984 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:24.004719 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f83fa5bf-c9ff-414b-8c0c-1f3b08c82984 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:24.010454 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7d88cc98-b3ff-49c7-8503-1e51e191e9c7 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:24.011053 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7d88cc98-b3ff-49c7-8503-1e51e191e9c7 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:24.016772 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7d88cc98-b3ff-49c7-8503-1e51e191e9c7 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:24.017212 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7d88cc98-b3ff-49c7-8503-1e51e191e9c7 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:24.018010 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7d88cc98-b3ff-49c7-8503-1e51e191e9c7 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:24.018441 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7d88cc98-b3ff-49c7-8503-1e51e191e9c7 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:24.118822 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f83fa5bf-c9ff-414b-8c0c-1f3b08c82984 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.126775 Nov 08 16:13:24.119614 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 248/503] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:23 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:24.124587 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b19ce623-072e-4710-be91-36a994726dac tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:24.125271 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b19ce623-072e-4710-be91-36a994726dac tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:24.131409 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b19ce623-072e-4710-be91-36a994726dac tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:24.131847 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b19ce623-072e-4710-be91-36a994726dac tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:24.132615 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b19ce623-072e-4710-be91-36a994726dac tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:24.133041 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b19ce623-072e-4710-be91-36a994726dac tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:24.151699 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7d88cc98-b3ff-49c7-8503-1e51e191e9c7 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:24.159374 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7d88cc98-b3ff-49c7-8503-1e51e191e9c7 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1514 microversion: 2.1 time: 0.152548 Nov 08 16:13:24.159951 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 256/504] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:24 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:24.165497 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-04c61cb8-fc68-47bd-a5be-5803b214d948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:24.166485 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-04c61cb8-fc68-47bd-a5be-5803b214d948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:24.179028 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-04c61cb8-fc68-47bd-a5be-5803b214d948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:24.179486 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-04c61cb8-fc68-47bd-a5be-5803b214d948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:24.180476 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-04c61cb8-fc68-47bd-a5be-5803b214d948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:24.180795 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-04c61cb8-fc68-47bd-a5be-5803b214d948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:24.206446 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b19ce623-072e-4710-be91-36a994726dac tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:24.216590 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b19ce623-072e-4710-be91-36a994726dac tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1270 microversion: 2.1 time: 0.094953 Nov 08 16:13:24.217485 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 249/505] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:24 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:24.290722 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5ecc27ab-6613-4474-84ed-a6594e50510f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:24.290722 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5ecc27ab-6613-4474-84ed-a6594e50510f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:24.304182 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5ecc27ab-6613-4474-84ed-a6594e50510f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:24.305202 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5ecc27ab-6613-4474-84ed-a6594e50510f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:24.307122 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5ecc27ab-6613-4474-84ed-a6594e50510f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:24.307782 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5ecc27ab-6613-4474-84ed-a6594e50510f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:24.309623 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-04c61cb8-fc68-47bd-a5be-5803b214d948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.148444 Nov 08 16:13:24.315079 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 257/506] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:24 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:24.365388 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-dba1982e-747a-4a75-b4f1-75a4c9a63349 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:24.366744 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-dba1982e-747a-4a75-b4f1-75a4c9a63349 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:24.376398 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dba1982e-747a-4a75-b4f1-75a4c9a63349 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:24.377083 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dba1982e-747a-4a75-b4f1-75a4c9a63349 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:24.378447 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dba1982e-747a-4a75-b4f1-75a4c9a63349 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:24.379571 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dba1982e-747a-4a75-b4f1-75a4c9a63349 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:24.471993 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-5ecc27ab-6613-4474-84ed-a6594e50510f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:24.484998 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5ecc27ab-6613-4474-84ed-a6594e50510f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1319 microversion: 2.1 time: 0.211371 Nov 08 16:13:24.485760 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 250/507] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:24 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:24.609751 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-fbb774a2-1a6e-4ba6-9c69-fd78b005f156 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:24.612718 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fbb774a2-1a6e-4ba6-9c69-fd78b005f156 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:24.619332 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-dba1982e-747a-4a75-b4f1-75a4c9a63349 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:24.627995 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-dba1982e-747a-4a75-b4f1-75a4c9a63349 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1266 microversion: 2.1 time: 0.268030 Nov 08 16:13:24.629131 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fbb774a2-1a6e-4ba6-9c69-fd78b005f156 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:24.629575 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fbb774a2-1a6e-4ba6-9c69-fd78b005f156 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:24.630403 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fbb774a2-1a6e-4ba6-9c69-fd78b005f156 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:24.631358 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fbb774a2-1a6e-4ba6-9c69-fd78b005f156 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:24.636773 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 258/508] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:24 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:24.666586 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fbb774a2-1a6e-4ba6-9c69-fd78b005f156 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Going to try to terminate instance {{(pid=115523) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:13:24.744262 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-fbb774a2-1a6e-4ba6-9c69-fd78b005f156 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "DELETE /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 204 len: 0 microversion: 2.1 time: 0.137858 Nov 08 16:13:24.745144 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 251/509] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:13:24 2021] DELETE /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 08 16:13:24.754312 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5e3ac938-d460-471c-9640-216b940e23fd tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:24.754923 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5e3ac938-d460-471c-9640-216b940e23fd tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:24.761396 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5e3ac938-d460-471c-9640-216b940e23fd tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:24.761886 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5e3ac938-d460-471c-9640-216b940e23fd tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:24.762764 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5e3ac938-d460-471c-9640-216b940e23fd tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:24.763203 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5e3ac938-d460-471c-9640-216b940e23fd tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:24.894471 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-5e3ac938-d460-471c-9640-216b940e23fd tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:24.902498 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5e3ac938-d460-471c-9640-216b940e23fd tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 200 len: 1504 microversion: 2.1 time: 0.152676 Nov 08 16:13:24.903220 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 259/510] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:24 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:25.131749 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8a715896-dda4-468d-a6b7-ffcbd0656f3a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:25.132810 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8a715896-dda4-468d-a6b7-ffcbd0656f3a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:25.139041 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8a715896-dda4-468d-a6b7-ffcbd0656f3a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:25.139486 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8a715896-dda4-468d-a6b7-ffcbd0656f3a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:25.140759 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8a715896-dda4-468d-a6b7-ffcbd0656f3a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:25.141435 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8a715896-dda4-468d-a6b7-ffcbd0656f3a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:25.237067 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-dfb1a1f3-8f82-4be9-9391-0bea88099785 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:25.237692 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-dfb1a1f3-8f82-4be9-9391-0bea88099785 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:25.244448 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dfb1a1f3-8f82-4be9-9391-0bea88099785 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:25.245076 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dfb1a1f3-8f82-4be9-9391-0bea88099785 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:25.246194 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dfb1a1f3-8f82-4be9-9391-0bea88099785 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:25.246779 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dfb1a1f3-8f82-4be9-9391-0bea88099785 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:25.255491 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8a715896-dda4-468d-a6b7-ffcbd0656f3a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.128209 Nov 08 16:13:25.256780 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 252/511] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:25 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:13:25.323915 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-31a744bc-44d6-416f-9b72-07d947d29406 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:25.325798 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-31a744bc-44d6-416f-9b72-07d947d29406 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:25.334209 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-31a744bc-44d6-416f-9b72-07d947d29406 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:25.335059 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-31a744bc-44d6-416f-9b72-07d947d29406 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:25.335983 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-31a744bc-44d6-416f-9b72-07d947d29406 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:25.336559 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-31a744bc-44d6-416f-9b72-07d947d29406 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:25.399929 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-dfb1a1f3-8f82-4be9-9391-0bea88099785 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:25.407166 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-dfb1a1f3-8f82-4be9-9391-0bea88099785 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1318 microversion: 2.1 time: 0.174109 Nov 08 16:13:25.407734 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 260/512] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:25 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:25.434178 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-31a744bc-44d6-416f-9b72-07d947d29406 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.116004 Nov 08 16:13:25.434845 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 253/513] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:25 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:25.501437 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c2b4a038-d41b-4693-a48b-7f64d06e099f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:25.502088 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c2b4a038-d41b-4693-a48b-7f64d06e099f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:25.508718 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c2b4a038-d41b-4693-a48b-7f64d06e099f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:25.509175 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c2b4a038-d41b-4693-a48b-7f64d06e099f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:25.509983 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c2b4a038-d41b-4693-a48b-7f64d06e099f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:25.510447 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c2b4a038-d41b-4693-a48b-7f64d06e099f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:25.642550 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c2b4a038-d41b-4693-a48b-7f64d06e099f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:25.645096 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-356fb2a7-bb85-4e84-b860-d24c39ab1309 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:25.645816 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-356fb2a7-bb85-4e84-b860-d24c39ab1309 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:25.650581 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c2b4a038-d41b-4693-a48b-7f64d06e099f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1319 microversion: 2.1 time: 0.153321 Nov 08 16:13:25.651239 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 261/514] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:25 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:25.652743 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-356fb2a7-bb85-4e84-b860-d24c39ab1309 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:25.653195 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-356fb2a7-bb85-4e84-b860-d24c39ab1309 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:25.654024 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-356fb2a7-bb85-4e84-b860-d24c39ab1309 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:25.654457 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-356fb2a7-bb85-4e84-b860-d24c39ab1309 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:25.703924 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-f6e6c8b4-c6d7-4b70-b37f-598c336dc8d6 req-c25aabcc-ad0b-447d-a551-5ab70bf261a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf462447-a55a-46b8-9afd-afca942aa011", "tag": "f47160fc-9457-4c27-a7dc-b4b4b112f9b1"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:25.706114 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:13:25.706114 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:13:25.719952 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-f6e6c8b4-c6d7-4b70-b37f-598c336dc8d6 req-c25aabcc-ad0b-447d-a551-5ab70bf261a8 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:25.721858 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-f6e6c8b4-c6d7-4b70-b37f-598c336dc8d6 req-c25aabcc-ad0b-447d-a551-5ab70bf261a8 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:25.748792 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-f6e6c8b4-c6d7-4b70-b37f-598c336dc8d6 req-c25aabcc-ad0b-447d-a551-5ab70bf261a8 service nova] Creating event network-changed:f47160fc-9457-4c27-a7dc-b4b4b112f9b1 for instance cf462447-a55a-46b8-9afd-afca942aa011 on hv-cinder-81618 Nov 08 16:13:25.749637 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-f6e6c8b4-c6d7-4b70-b37f-598c336dc8d6 req-c25aabcc-ad0b-447d-a551-5ab70bf261a8 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049742 Nov 08 16:13:25.750681 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 262/515] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:13:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:13:25.819042 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-356fb2a7-bb85-4e84-b860-d24c39ab1309 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:25.826346 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-356fb2a7-bb85-4e84-b860-d24c39ab1309 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1266 microversion: 2.1 time: 0.185217 Nov 08 16:13:25.826893 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 254/516] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:25 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:25.920612 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ec6fa545-47e6-4afc-9ce2-bc6f1d4e8b75 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:25.921221 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ec6fa545-47e6-4afc-9ce2-bc6f1d4e8b75 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:25.927081 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ec6fa545-47e6-4afc-9ce2-bc6f1d4e8b75 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:25.927573 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ec6fa545-47e6-4afc-9ce2-bc6f1d4e8b75 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:25.928318 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ec6fa545-47e6-4afc-9ce2-bc6f1d4e8b75 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:25.928744 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ec6fa545-47e6-4afc-9ce2-bc6f1d4e8b75 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:26.058062 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-ec6fa545-47e6-4afc-9ce2-bc6f1d4e8b75 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:26.066056 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ec6fa545-47e6-4afc-9ce2-bc6f1d4e8b75 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 200 len: 1504 microversion: 2.1 time: 0.150019 Nov 08 16:13:26.066629 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 263/517] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:25 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:26.268157 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-fb23477b-088e-4ffb-acfc-a16e00244cfc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:26.269090 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fb23477b-088e-4ffb-acfc-a16e00244cfc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:26.275231 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fb23477b-088e-4ffb-acfc-a16e00244cfc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:26.275665 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fb23477b-088e-4ffb-acfc-a16e00244cfc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:26.276427 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fb23477b-088e-4ffb-acfc-a16e00244cfc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:26.276843 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fb23477b-088e-4ffb-acfc-a16e00244cfc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:26.424529 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4f92f235-9d24-4d8a-a03a-0e73a2c81a0d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:26.425127 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4f92f235-9d24-4d8a-a03a-0e73a2c81a0d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:26.431438 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4f92f235-9d24-4d8a-a03a-0e73a2c81a0d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:26.431879 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4f92f235-9d24-4d8a-a03a-0e73a2c81a0d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:26.432804 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4f92f235-9d24-4d8a-a03a-0e73a2c81a0d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:26.433234 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4f92f235-9d24-4d8a-a03a-0e73a2c81a0d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:26.562197 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4f92f235-9d24-4d8a-a03a-0e73a2c81a0d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:26.569980 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4f92f235-9d24-4d8a-a03a-0e73a2c81a0d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1318 microversion: 2.1 time: 0.149182 Nov 08 16:13:26.570638 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 264/518] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:26 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:26.574982 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1254ff6f-5486-46d0-92b3-2ac05f506b7f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:26.575935 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1254ff6f-5486-46d0-92b3-2ac05f506b7f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:26.581358 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1254ff6f-5486-46d0-92b3-2ac05f506b7f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:26.581832 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1254ff6f-5486-46d0-92b3-2ac05f506b7f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:26.582670 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1254ff6f-5486-46d0-92b3-2ac05f506b7f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:26.583228 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1254ff6f-5486-46d0-92b3-2ac05f506b7f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:27.129377 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-fb23477b-088e-4ffb-acfc-a16e00244cfc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.864695 Nov 08 16:13:27.133214 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 255/519] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:26 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:27.134960 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f9684a89-c184-4791-ac4f-bf30715fea27 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:27.135643 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f9684a89-c184-4791-ac4f-bf30715fea27 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:27.142420 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f9684a89-c184-4791-ac4f-bf30715fea27 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:27.142861 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f9684a89-c184-4791-ac4f-bf30715fea27 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:27.143619 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f9684a89-c184-4791-ac4f-bf30715fea27 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:27.144045 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f9684a89-c184-4791-ac4f-bf30715fea27 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:27.274857 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f9684a89-c184-4791-ac4f-bf30715fea27 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:27.282702 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f9684a89-c184-4791-ac4f-bf30715fea27 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1319 microversion: 2.1 time: 0.151314 Nov 08 16:13:27.293245 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 256/520] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:27 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:27.293245 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c497c123-ddb0-43d6-91f9-c7c04e51d558 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:27.293245 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c497c123-ddb0-43d6-91f9-c7c04e51d558 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:27.294163 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c497c123-ddb0-43d6-91f9-c7c04e51d558 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:27.294609 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c497c123-ddb0-43d6-91f9-c7c04e51d558 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:27.295378 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c497c123-ddb0-43d6-91f9-c7c04e51d558 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:27.295841 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c497c123-ddb0-43d6-91f9-c7c04e51d558 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:27.423444 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c497c123-ddb0-43d6-91f9-c7c04e51d558 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:27.431150 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c497c123-ddb0-43d6-91f9-c7c04e51d558 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1266 microversion: 2.1 time: 0.146933 Nov 08 16:13:27.431714 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 257/521] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:27 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:27.439427 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1fae0db9-7531-48c8-982f-c7ce1df87a1c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:27.440030 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1fae0db9-7531-48c8-982f-c7ce1df87a1c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:27.445840 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1fae0db9-7531-48c8-982f-c7ce1df87a1c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:27.446278 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1fae0db9-7531-48c8-982f-c7ce1df87a1c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:27.447048 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1fae0db9-7531-48c8-982f-c7ce1df87a1c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:27.447496 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1fae0db9-7531-48c8-982f-c7ce1df87a1c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:27.573806 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1fae0db9-7531-48c8-982f-c7ce1df87a1c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:27.580913 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1fae0db9-7531-48c8-982f-c7ce1df87a1c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 200 len: 1504 microversion: 2.1 time: 0.148269 Nov 08 16:13:27.581792 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 258/522] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:27 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:27.585881 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c90c2022-e1f6-4a07-bda5-c9b5cf787b1d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:27.586473 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c90c2022-e1f6-4a07-bda5-c9b5cf787b1d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:27.591852 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c90c2022-e1f6-4a07-bda5-c9b5cf787b1d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:27.592289 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c90c2022-e1f6-4a07-bda5-c9b5cf787b1d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:27.593048 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c90c2022-e1f6-4a07-bda5-c9b5cf787b1d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:27.593502 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c90c2022-e1f6-4a07-bda5-c9b5cf787b1d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:27.719044 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c90c2022-e1f6-4a07-bda5-c9b5cf787b1d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:27.726823 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c90c2022-e1f6-4a07-bda5-c9b5cf787b1d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1318 microversion: 2.1 time: 0.144130 Nov 08 16:13:27.727375 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 259/523] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:27 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:27.731519 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-bfb09d0d-7efc-4e98-a346-a5758eaa0d28 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:27.732105 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-bfb09d0d-7efc-4e98-a346-a5758eaa0d28 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:27.737609 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bfb09d0d-7efc-4e98-a346-a5758eaa0d28 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:27.738080 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bfb09d0d-7efc-4e98-a346-a5758eaa0d28 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:27.738959 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bfb09d0d-7efc-4e98-a346-a5758eaa0d28 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:27.739391 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bfb09d0d-7efc-4e98-a346-a5758eaa0d28 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:27.763100 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1254ff6f-5486-46d0-92b3-2ac05f506b7f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 1.191249 Nov 08 16:13:27.767249 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 265/524] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:26 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:27.871244 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-bfb09d0d-7efc-4e98-a346-a5758eaa0d28 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:27.878788 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-bfb09d0d-7efc-4e98-a346-a5758eaa0d28 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1514 microversion: 2.1 time: 0.150415 Nov 08 16:13:27.879281 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 260/525] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:27 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:27.895066 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c9cb63e9-1680-4d74-90a8-9aa69d6e1ab0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56d2fe1f-b380-431c-8242-f9db69bda9ac"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:27.896201 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c9cb63e9-1680-4d74-90a8-9aa69d6e1ab0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:27.903503 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c9cb63e9-1680-4d74-90a8-9aa69d6e1ab0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:27.903955 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c9cb63e9-1680-4d74-90a8-9aa69d6e1ab0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:27.904724 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c9cb63e9-1680-4d74-90a8-9aa69d6e1ab0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:27.905159 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c9cb63e9-1680-4d74-90a8-9aa69d6e1ab0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:28.141650 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-bc7e1ddb-0342-41f1-8f93-02efef6e0b32 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:28.142585 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-bc7e1ddb-0342-41f1-8f93-02efef6e0b32 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:28.149756 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bc7e1ddb-0342-41f1-8f93-02efef6e0b32 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:28.150201 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bc7e1ddb-0342-41f1-8f93-02efef6e0b32 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:28.151867 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bc7e1ddb-0342-41f1-8f93-02efef6e0b32 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:28.152328 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bc7e1ddb-0342-41f1-8f93-02efef6e0b32 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:28.152842 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c9cb63e9-1680-4d74-90a8-9aa69d6e1ab0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "POST /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261718 Nov 08 16:13:28.153449 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 266/526] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Nov 8 16:13:27 2021] POST /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:13:28.300824 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-06439bd7-622d-4321-ab13-ccd1ccbbedce tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:28.301511 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-06439bd7-622d-4321-ab13-ccd1ccbbedce tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:28.307848 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-06439bd7-622d-4321-ab13-ccd1ccbbedce tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:28.308436 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-06439bd7-622d-4321-ab13-ccd1ccbbedce tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:28.309067 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-06439bd7-622d-4321-ab13-ccd1ccbbedce tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:28.309489 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-06439bd7-622d-4321-ab13-ccd1ccbbedce tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:28.436912 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-06439bd7-622d-4321-ab13-ccd1ccbbedce tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:28.444705 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-06439bd7-622d-4321-ab13-ccd1ccbbedce tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1507 microversion: 2.1 time: 0.148332 Nov 08 16:13:28.445265 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 267/527] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:28 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:28.449518 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7202d515-f775-4e42-ae20-fd5419fe274d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:28.450136 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7202d515-f775-4e42-ae20-fd5419fe274d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:28.455479 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7202d515-f775-4e42-ae20-fd5419fe274d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:28.455999 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7202d515-f775-4e42-ae20-fd5419fe274d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:28.456855 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7202d515-f775-4e42-ae20-fd5419fe274d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:28.457835 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7202d515-f775-4e42-ae20-fd5419fe274d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:28.586913 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-bc7e1ddb-0342-41f1-8f93-02efef6e0b32 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.449472 Nov 08 16:13:28.587561 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 261/528] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:28 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:13:28.594453 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7202d515-f775-4e42-ae20-fd5419fe274d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:28.598542 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-080457e2-adf2-413f-8512-224d11fcb1e4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:28.599511 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-080457e2-adf2-413f-8512-224d11fcb1e4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:28.604138 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7202d515-f775-4e42-ae20-fd5419fe274d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1266 microversion: 2.1 time: 0.157504 Nov 08 16:13:28.605372 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 268/529] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:28 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:28.607088 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-080457e2-adf2-413f-8512-224d11fcb1e4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:28.607526 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-080457e2-adf2-413f-8512-224d11fcb1e4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:28.608306 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-080457e2-adf2-413f-8512-224d11fcb1e4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:28.608791 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-080457e2-adf2-413f-8512-224d11fcb1e4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:28.744455 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f903cf2d-5750-4194-8129-e83ceb16838e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:28.745529 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f903cf2d-5750-4194-8129-e83ceb16838e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:28.748713 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-080457e2-adf2-413f-8512-224d11fcb1e4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:28.753065 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f903cf2d-5750-4194-8129-e83ceb16838e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:28.753514 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f903cf2d-5750-4194-8129-e83ceb16838e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:28.754317 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f903cf2d-5750-4194-8129-e83ceb16838e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:28.754748 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f903cf2d-5750-4194-8129-e83ceb16838e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:28.756837 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-080457e2-adf2-413f-8512-224d11fcb1e4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 200 len: 1504 microversion: 2.1 time: 0.162572 Nov 08 16:13:28.757695 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 262/530] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:28 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:28.774988 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-fbca2f8b-8629-4695-bd30-c2425973e868 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:28.776232 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fbca2f8b-8629-4695-bd30-c2425973e868 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:28.782304 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fbca2f8b-8629-4695-bd30-c2425973e868 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:28.782838 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fbca2f8b-8629-4695-bd30-c2425973e868 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:28.783688 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fbca2f8b-8629-4695-bd30-c2425973e868 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:28.784190 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fbca2f8b-8629-4695-bd30-c2425973e868 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:28.906285 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f903cf2d-5750-4194-8129-e83ceb16838e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:28.914073 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f903cf2d-5750-4194-8129-e83ceb16838e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1318 microversion: 2.1 time: 0.174140 Nov 08 16:13:28.914624 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 269/531] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:28 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:28.953834 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-fbca2f8b-8629-4695-bd30-c2425973e868 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.182772 Nov 08 16:13:28.954410 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 263/532] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:28 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:13:29.598594 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a1c4a4e4-d6c8-4869-aedf-79f301c509a6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:29.600106 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a1c4a4e4-d6c8-4869-aedf-79f301c509a6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:29.607947 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a1c4a4e4-d6c8-4869-aedf-79f301c509a6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:29.608391 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a1c4a4e4-d6c8-4869-aedf-79f301c509a6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:29.609758 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a1c4a4e4-d6c8-4869-aedf-79f301c509a6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:29.610204 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a1c4a4e4-d6c8-4869-aedf-79f301c509a6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:29.620569 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-2306b0f2-07b6-46f5-8369-f64bf9291c49 req-5125f327-c29f-4a7b-ae3c-dec2a7af8abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be55525-c510-4909-a898-370d4760deea", "name": "network-vif-deleted", "tag": "00b6d387-6249-49c0-81db-f2b5b8a1ce31"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:29.622217 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:13:29.622217 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:13:29.631539 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-2306b0f2-07b6-46f5-8369-f64bf9291c49 req-5125f327-c29f-4a7b-ae3c-dec2a7af8abd service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:29.632032 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-2306b0f2-07b6-46f5-8369-f64bf9291c49 req-5125f327-c29f-4a7b-ae3c-dec2a7af8abd service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:29.643362 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-2306b0f2-07b6-46f5-8369-f64bf9291c49 req-5125f327-c29f-4a7b-ae3c-dec2a7af8abd service nova] Creating event network-vif-deleted:00b6d387-6249-49c0-81db-f2b5b8a1ce31 for instance 2be55525-c510-4909-a898-370d4760deea on hv-cinder-81618 Nov 08 16:13:29.648040 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-2306b0f2-07b6-46f5-8369-f64bf9291c49 req-5125f327-c29f-4a7b-ae3c-dec2a7af8abd service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035625 Nov 08 16:13:29.648629 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 264/533] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:13:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:13:29.653503 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5da75b94-84e7-4499-9a97-cb6a4e00a3fb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:29.654212 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5da75b94-84e7-4499-9a97-cb6a4e00a3fb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:29.660296 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5da75b94-84e7-4499-9a97-cb6a4e00a3fb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:29.660836 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5da75b94-84e7-4499-9a97-cb6a4e00a3fb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:29.662499 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5da75b94-84e7-4499-9a97-cb6a4e00a3fb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:29.663059 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5da75b94-84e7-4499-9a97-cb6a4e00a3fb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:29.806194 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-5da75b94-84e7-4499-9a97-cb6a4e00a3fb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:29.813778 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5da75b94-84e7-4499-9a97-cb6a4e00a3fb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1266 microversion: 2.1 time: 0.163777 Nov 08 16:13:29.814455 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 265/534] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:29 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:29.819251 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-df935bb9-953b-44e8-b52c-33a0250ff4c0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:29.819799 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-df935bb9-953b-44e8-b52c-33a0250ff4c0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:29.825950 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-df935bb9-953b-44e8-b52c-33a0250ff4c0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:29.826397 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-df935bb9-953b-44e8-b52c-33a0250ff4c0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:29.827191 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-df935bb9-953b-44e8-b52c-33a0250ff4c0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:29.827621 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-df935bb9-953b-44e8-b52c-33a0250ff4c0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:29.858309 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-df935bb9-953b-44e8-b52c-33a0250ff4c0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:29.858753 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-df935bb9-953b-44e8-b52c-33a0250ff4c0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:29.859191 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.objects.instance [None req-df935bb9-953b-44e8-b52c-33a0250ff4c0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lazy-loading 'fault' on Instance uuid 2be55525-c510-4909-a898-370d4760deea {{(pid=115523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:13:29.899388 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a1c4a4e4-d6c8-4869-aedf-79f301c509a6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.304076 Nov 08 16:13:29.903181 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 270/535] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:29 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:29.903521 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-df935bb9-953b-44e8-b52c-33a0250ff4c0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:29.909772 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-df935bb9-953b-44e8-b52c-33a0250ff4c0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 200 len: 1304 microversion: 2.1 time: 0.093944 Nov 08 16:13:29.910490 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 266/536] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:29 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:29.932046 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f541534c-55a5-402e-8f8d-1a36381d9aa3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:29.932796 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f541534c-55a5-402e-8f8d-1a36381d9aa3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:29.939417 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f541534c-55a5-402e-8f8d-1a36381d9aa3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:29.940022 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f541534c-55a5-402e-8f8d-1a36381d9aa3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:29.940812 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f541534c-55a5-402e-8f8d-1a36381d9aa3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:29.941243 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f541534c-55a5-402e-8f8d-1a36381d9aa3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:29.964687 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-2a7f3209-f5e8-4734-8f7b-95e687b737d0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:29.965606 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-2a7f3209-f5e8-4734-8f7b-95e687b737d0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:29.971365 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2a7f3209-f5e8-4734-8f7b-95e687b737d0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:29.971803 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2a7f3209-f5e8-4734-8f7b-95e687b737d0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:29.972569 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2a7f3209-f5e8-4734-8f7b-95e687b737d0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:29.972996 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2a7f3209-f5e8-4734-8f7b-95e687b737d0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:30.071938 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f541534c-55a5-402e-8f8d-1a36381d9aa3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:30.079478 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f541534c-55a5-402e-8f8d-1a36381d9aa3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1318 microversion: 2.1 time: 0.152267 Nov 08 16:13:30.080032 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 271/537] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:29 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:30.264821 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-2a7f3209-f5e8-4734-8f7b-95e687b737d0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.303926 Nov 08 16:13:30.265938 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 267/538] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:29 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:13:30.830612 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-413c91ad-85f8-46c2-ba70-b7a4e2860233 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:30.831214 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-413c91ad-85f8-46c2-ba70-b7a4e2860233 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:30.837502 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-413c91ad-85f8-46c2-ba70-b7a4e2860233 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:30.837982 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-413c91ad-85f8-46c2-ba70-b7a4e2860233 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:30.838751 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-413c91ad-85f8-46c2-ba70-b7a4e2860233 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:30.839180 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-413c91ad-85f8-46c2-ba70-b7a4e2860233 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:30.910672 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-317563aa-be5f-4d52-b1bd-6795f6434e3c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:30.911664 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-317563aa-be5f-4d52-b1bd-6795f6434e3c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:30.918429 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-317563aa-be5f-4d52-b1bd-6795f6434e3c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:30.918872 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-317563aa-be5f-4d52-b1bd-6795f6434e3c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:30.919640 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-317563aa-be5f-4d52-b1bd-6795f6434e3c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:30.920069 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-317563aa-be5f-4d52-b1bd-6795f6434e3c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:30.992849 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-413c91ad-85f8-46c2-ba70-b7a4e2860233 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:31.000333 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-413c91ad-85f8-46c2-ba70-b7a4e2860233 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1266 microversion: 2.1 time: 0.173477 Nov 08 16:13:31.000888 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 272/539] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:30 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:31.005557 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bab43348-bcd2-4e3e-bc2c-4535032e3432 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:31.006477 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-bab43348-bcd2-4e3e-bc2c-4535032e3432 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 2be55525-c510-4909-a898-370d4760deea] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:31.012094 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bab43348-bcd2-4e3e-bc2c-4535032e3432 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:31.012547 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bab43348-bcd2-4e3e-bc2c-4535032e3432 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:31.013322 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bab43348-bcd2-4e3e-bc2c-4535032e3432 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:31.013779 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bab43348-bcd2-4e3e-bc2c-4535032e3432 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:31.024697 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-317563aa-be5f-4d52-b1bd-6795f6434e3c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.117917 Nov 08 16:13:31.025333 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 268/540] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:30 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:13:31.027266 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-bab43348-bcd2-4e3e-bc2c-4535032e3432 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] HTTP exception thrown: Instance 2be55525-c510-4909-a898-370d4760deea could not be found. Nov 08 16:13:31.027910 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bab43348-bcd2-4e3e-bc2c-4535032e3432 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Returning 404 to user: Instance 2be55525-c510-4909-a898-370d4760deea could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:13:31.028921 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bab43348-bcd2-4e3e-bc2c-4535032e3432 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea" status: 404 len: 111 microversion: 2.1 time: 0.027006 Nov 08 16:13:31.029480 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 273/541] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:31 2021] GET /compute/v2.1/servers/2be55525-c510-4909-a898-370d4760deea => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:13:31.080191 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1844219377", "imageRef": "9abeafba-e602-4e0a-aab2-62160562de06", "flavorRef": "452", "networks": [{"uuid": "e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e"}]}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:31.095798 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e96ce68f-86a6-447c-b8e7-e611c803107e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:31.096398 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e96ce68f-86a6-447c-b8e7-e611c803107e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:31.103218 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e96ce68f-86a6-447c-b8e7-e611c803107e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:31.103661 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e96ce68f-86a6-447c-b8e7-e611c803107e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:31.104424 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e96ce68f-86a6-447c-b8e7-e611c803107e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:31.104848 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e96ce68f-86a6-447c-b8e7-e611c803107e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:31.136849 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.network.neutron [None req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] validate_networks() for [('e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e', None, None, None, None, None)] {{(pid=115523) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:13:31.325208 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e96ce68f-86a6-447c-b8e7-e611c803107e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:31.332463 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e96ce68f-86a6-447c-b8e7-e611c803107e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1318 microversion: 2.1 time: 0.240223 Nov 08 16:13:31.333406 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 274/542] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:31 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:31.347086 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ad602527-ddbc-4067-b158-0a343c0506eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:31.348093 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ad602527-ddbc-4067-b158-0a343c0506eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:31.355150 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad602527-ddbc-4067-b158-0a343c0506eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:31.355704 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad602527-ddbc-4067-b158-0a343c0506eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:31.356565 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad602527-ddbc-4067-b158-0a343c0506eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:31.357002 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad602527-ddbc-4067-b158-0a343c0506eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:31.508966 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ad602527-ddbc-4067-b158-0a343c0506eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.166409 Nov 08 16:13:31.512945 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 275/543] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:31 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:31.538341 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Flavor limits 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:13:31.538750 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Image limits 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:13:31.539210 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Flavor pref 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:13:31.539613 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Image pref 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:13:31.540039 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:13:31.548370 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:31.548803 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:31.549589 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:31.550058 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:31.567860 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Getting quotas for project 9580ccbb790e4dff94da99ac8b1c98d5. Resources: {'instances', 'ram', 'cores'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:13:31.572474 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Getting quotas for user 39e2605b08484b20b429bb32fab97a39 and project 9580ccbb790e4dff94da99ac8b1c98d5. Resources: {'instances', 'ram', 'cores'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:13:31.583029 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Going to run 1 instances... {{(pid=115523) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:13:31.585438 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9abeafba-e602-4e0a-aab2-62160562de06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:13:31.629917 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553521 Nov 08 16:13:31.630496 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 269/544] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Nov 8 16:13:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 16:13:31.641207 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-27b4e002-118c-48e7-a725-1677193c5a72 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:31.641972 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-27b4e002-118c-48e7-a725-1677193c5a72 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:31.697313 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-27b4e002-118c-48e7-a725-1677193c5a72 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:31.703965 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-27b4e002-118c-48e7-a725-1677193c5a72 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1214 microversion: 2.1 time: 0.066801 Nov 08 16:13:31.706058 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 276/545] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:31 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:32.018675 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-397d9957-9b99-418a-b1fc-a2a4941b427f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:32.020739 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-397d9957-9b99-418a-b1fc-a2a4941b427f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:32.029331 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-397d9957-9b99-418a-b1fc-a2a4941b427f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:32.032237 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-397d9957-9b99-418a-b1fc-a2a4941b427f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:32.033618 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-397d9957-9b99-418a-b1fc-a2a4941b427f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:32.034527 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-397d9957-9b99-418a-b1fc-a2a4941b427f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:32.038222 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-fcc70a7b-a6c0-4fba-b16f-3feed921642a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:32.039152 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-fcc70a7b-a6c0-4fba-b16f-3feed921642a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:32.053064 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fcc70a7b-a6c0-4fba-b16f-3feed921642a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:32.063846 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fcc70a7b-a6c0-4fba-b16f-3feed921642a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:32.065115 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fcc70a7b-a6c0-4fba-b16f-3feed921642a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:32.065800 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fcc70a7b-a6c0-4fba-b16f-3feed921642a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:32.181644 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-fcc70a7b-a6c0-4fba-b16f-3feed921642a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.148337 Nov 08 16:13:32.182713 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 277/546] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:32 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:32.226304 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-397d9957-9b99-418a-b1fc-a2a4941b427f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:32.234667 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-397d9957-9b99-418a-b1fc-a2a4941b427f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1266 microversion: 2.1 time: 0.221450 Nov 08 16:13:32.235118 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 270/547] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:32 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:32.348714 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9fc5e5c4-842e-414f-88cf-3919789ee1ad tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:32.349395 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9fc5e5c4-842e-414f-88cf-3919789ee1ad tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:32.356207 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9fc5e5c4-842e-414f-88cf-3919789ee1ad tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:32.356644 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9fc5e5c4-842e-414f-88cf-3919789ee1ad tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:32.357402 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9fc5e5c4-842e-414f-88cf-3919789ee1ad tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:32.357853 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9fc5e5c4-842e-414f-88cf-3919789ee1ad tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:32.487709 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-9fc5e5c4-842e-414f-88cf-3919789ee1ad tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:32.495863 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9fc5e5c4-842e-414f-88cf-3919789ee1ad tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1318 microversion: 2.1 time: 0.151192 Nov 08 16:13:32.496431 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 278/548] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:32 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:32.520404 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-52078da6-f311-457e-a60e-4326e52f2798 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:32.521365 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-52078da6-f311-457e-a60e-4326e52f2798 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:32.527211 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-52078da6-f311-457e-a60e-4326e52f2798 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:32.527647 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-52078da6-f311-457e-a60e-4326e52f2798 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:32.528410 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-52078da6-f311-457e-a60e-4326e52f2798 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:32.528835 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-52078da6-f311-457e-a60e-4326e52f2798 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:32.625783 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-52078da6-f311-457e-a60e-4326e52f2798 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.108802 Nov 08 16:13:32.626680 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 271/549] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:32 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:32.720378 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-492c7b1c-ae3a-451a-8892-f45b2b718f11 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:32.721130 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-492c7b1c-ae3a-451a-8892-f45b2b718f11 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:32.730555 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-492c7b1c-ae3a-451a-8892-f45b2b718f11 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:32.731186 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-492c7b1c-ae3a-451a-8892-f45b2b718f11 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:32.732086 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-492c7b1c-ae3a-451a-8892-f45b2b718f11 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:32.732598 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-492c7b1c-ae3a-451a-8892-f45b2b718f11 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:32.795521 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-492c7b1c-ae3a-451a-8892-f45b2b718f11 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:32.802868 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-492c7b1c-ae3a-451a-8892-f45b2b718f11 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1284 microversion: 2.1 time: 0.086291 Nov 08 16:13:32.803490 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 279/550] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:32 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:33.194488 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d13b8dad-ddb8-4a12-9d82-07b411764d0d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:33.195508 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d13b8dad-ddb8-4a12-9d82-07b411764d0d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:33.202211 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d13b8dad-ddb8-4a12-9d82-07b411764d0d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:33.202648 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d13b8dad-ddb8-4a12-9d82-07b411764d0d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:33.203414 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d13b8dad-ddb8-4a12-9d82-07b411764d0d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:33.203835 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d13b8dad-ddb8-4a12-9d82-07b411764d0d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:33.252372 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b43c86b9-3c40-42d6-acb2-80edc6a659d9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:33.253516 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b43c86b9-3c40-42d6-acb2-80edc6a659d9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:33.260089 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b43c86b9-3c40-42d6-acb2-80edc6a659d9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:33.260538 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b43c86b9-3c40-42d6-acb2-80edc6a659d9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:33.261318 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b43c86b9-3c40-42d6-acb2-80edc6a659d9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:33.261780 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b43c86b9-3c40-42d6-acb2-80edc6a659d9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:33.282147 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d13b8dad-ddb8-4a12-9d82-07b411764d0d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28148 microversion: 2.1 time: 0.091475 Nov 08 16:13:33.282898 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 272/551] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:33 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28148 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:33.403810 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b43c86b9-3c40-42d6-acb2-80edc6a659d9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:33.413320 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b43c86b9-3c40-42d6-acb2-80edc6a659d9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1266 microversion: 2.1 time: 0.164676 Nov 08 16:13:33.415156 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 280/552] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:33 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:33.513202 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f4c26cf7-4021-4c3d-9c8f-7f7feb658da6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:33.513913 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f4c26cf7-4021-4c3d-9c8f-7f7feb658da6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:33.520941 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f4c26cf7-4021-4c3d-9c8f-7f7feb658da6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:33.521467 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f4c26cf7-4021-4c3d-9c8f-7f7feb658da6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:33.522949 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f4c26cf7-4021-4c3d-9c8f-7f7feb658da6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:33.523441 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f4c26cf7-4021-4c3d-9c8f-7f7feb658da6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:33.637660 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7b8cb757-6ef2-4399-b931-7a25b14df6fb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:33.639058 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7b8cb757-6ef2-4399-b931-7a25b14df6fb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:33.644908 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7b8cb757-6ef2-4399-b931-7a25b14df6fb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:33.645636 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7b8cb757-6ef2-4399-b931-7a25b14df6fb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:33.646523 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7b8cb757-6ef2-4399-b931-7a25b14df6fb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:33.647013 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7b8cb757-6ef2-4399-b931-7a25b14df6fb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:33.665476 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f4c26cf7-4021-4c3d-9c8f-7f7feb658da6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:33.672782 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f4c26cf7-4021-4c3d-9c8f-7f7feb658da6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1318 microversion: 2.1 time: 0.163495 Nov 08 16:13:33.683070 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 273/553] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:33 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:33.821185 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1faf18a0-535b-4d68-9211-db331123b29c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:33.821842 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1faf18a0-535b-4d68-9211-db331123b29c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:33.828074 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1faf18a0-535b-4d68-9211-db331123b29c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:33.828517 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1faf18a0-535b-4d68-9211-db331123b29c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:33.829303 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1faf18a0-535b-4d68-9211-db331123b29c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:33.829762 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1faf18a0-535b-4d68-9211-db331123b29c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:33.834976 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7b8cb757-6ef2-4399-b931-7a25b14df6fb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28171 microversion: 2.20 time: 0.200765 Nov 08 16:13:33.836207 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 281/554] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:33 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28171 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:13:33.962981 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1faf18a0-535b-4d68-9211-db331123b29c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:33.970405 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1faf18a0-535b-4d68-9211-db331123b29c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.153537 Nov 08 16:13:33.970978 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 274/555] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:33 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:34.003487 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-7775fe96-097d-415f-bfce-4ce06f9636af req-adc76234-8099-4c45-b1bb-0b54e184e83d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37e5636f-2ecf-4438-8be2-e973029678a1", "tag": "2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:34.005952 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:13:34.005952 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:13:34.015401 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-7775fe96-097d-415f-bfce-4ce06f9636af req-adc76234-8099-4c45-b1bb-0b54e184e83d service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:34.016214 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-7775fe96-097d-415f-bfce-4ce06f9636af req-adc76234-8099-4c45-b1bb-0b54e184e83d service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:34.030550 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-7775fe96-097d-415f-bfce-4ce06f9636af req-adc76234-8099-4c45-b1bb-0b54e184e83d service nova] Creating event network-changed:2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e for instance 37e5636f-2ecf-4438-8be2-e973029678a1 on hv-cinder-81618 Nov 08 16:13:34.035372 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-7775fe96-097d-415f-bfce-4ce06f9636af req-adc76234-8099-4c45-b1bb-0b54e184e83d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037517 Nov 08 16:13:34.036204 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 282/556] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:13:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:13:34.294162 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4c52769d-3017-4590-8e59-f9a5f5acd738 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:34.295349 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4c52769d-3017-4590-8e59-f9a5f5acd738 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:34.301566 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4c52769d-3017-4590-8e59-f9a5f5acd738 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:34.302095 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4c52769d-3017-4590-8e59-f9a5f5acd738 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:34.302852 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4c52769d-3017-4590-8e59-f9a5f5acd738 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:34.303271 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4c52769d-3017-4590-8e59-f9a5f5acd738 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:34.431286 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-6533f571-65bb-4281-93d4-7121e660a33a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:34.431942 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-6533f571-65bb-4281-93d4-7121e660a33a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:34.438014 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6533f571-65bb-4281-93d4-7121e660a33a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:34.438453 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6533f571-65bb-4281-93d4-7121e660a33a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:34.439216 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6533f571-65bb-4281-93d4-7121e660a33a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:34.439642 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6533f571-65bb-4281-93d4-7121e660a33a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:34.574896 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-6533f571-65bb-4281-93d4-7121e660a33a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:34.582372 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-6533f571-65bb-4281-93d4-7121e660a33a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1266 microversion: 2.1 time: 0.155971 Nov 08 16:13:34.582956 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 283/557] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:34 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:34.678865 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4c52769d-3017-4590-8e59-f9a5f5acd738 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28437 microversion: 2.1 time: 0.387547 Nov 08 16:13:34.679554 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 275/558] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:34 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28437 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:34.690544 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ef98dc7e-0ec6-4dcc-bd49-30b59b4f3a79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:34.691072 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ef98dc7e-0ec6-4dcc-bd49-30b59b4f3a79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:34.698319 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ef98dc7e-0ec6-4dcc-bd49-30b59b4f3a79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:34.698771 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ef98dc7e-0ec6-4dcc-bd49-30b59b4f3a79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:34.699558 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ef98dc7e-0ec6-4dcc-bd49-30b59b4f3a79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:34.699996 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ef98dc7e-0ec6-4dcc-bd49-30b59b4f3a79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:34.836597 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-ef98dc7e-0ec6-4dcc-bd49-30b59b4f3a79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:34.844385 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ef98dc7e-0ec6-4dcc-bd49-30b59b4f3a79 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1318 microversion: 2.1 time: 0.157650 Nov 08 16:13:34.854218 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ffc3afc0-cf92-42dc-88a4-486f48a97120 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:34.854218 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ffc3afc0-cf92-42dc-88a4-486f48a97120 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:34.855213 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 284/559] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:34 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:34.856011 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ffc3afc0-cf92-42dc-88a4-486f48a97120 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:34.856448 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ffc3afc0-cf92-42dc-88a4-486f48a97120 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:34.857219 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ffc3afc0-cf92-42dc-88a4-486f48a97120 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:34.857646 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ffc3afc0-cf92-42dc-88a4-486f48a97120 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:34.987586 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-990f5877-b922-494c-903b-f8271622cdd6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:34.988180 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-990f5877-b922-494c-903b-f8271622cdd6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:34.994858 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-990f5877-b922-494c-903b-f8271622cdd6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:34.995296 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-990f5877-b922-494c-903b-f8271622cdd6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:34.996062 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-990f5877-b922-494c-903b-f8271622cdd6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:34.996488 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-990f5877-b922-494c-903b-f8271622cdd6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:35.098200 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ffc3afc0-cf92-42dc-88a4-486f48a97120 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28461 microversion: 2.20 time: 0.254545 Nov 08 16:13:35.099385 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 276/560] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:34 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28461 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:35.150724 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-990f5877-b922-494c-903b-f8271622cdd6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:35.157954 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-990f5877-b922-494c-903b-f8271622cdd6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.174130 Nov 08 16:13:35.168106 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 285/561] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:34 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:35.600195 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5a0f3a32-84e4-42f7-93b9-33268fe76aa5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:35.600883 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5a0f3a32-84e4-42f7-93b9-33268fe76aa5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:35.608039 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5a0f3a32-84e4-42f7-93b9-33268fe76aa5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:35.608478 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5a0f3a32-84e4-42f7-93b9-33268fe76aa5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:35.609257 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5a0f3a32-84e4-42f7-93b9-33268fe76aa5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:35.609690 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5a0f3a32-84e4-42f7-93b9-33268fe76aa5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:35.690775 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3e5a4fe7-f850-4614-903b-5a1561101ed1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:35.691751 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3e5a4fe7-f850-4614-903b-5a1561101ed1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:35.698947 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3e5a4fe7-f850-4614-903b-5a1561101ed1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:35.699397 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3e5a4fe7-f850-4614-903b-5a1561101ed1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:35.700176 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3e5a4fe7-f850-4614-903b-5a1561101ed1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:35.700611 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3e5a4fe7-f850-4614-903b-5a1561101ed1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:35.744911 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-5a0f3a32-84e4-42f7-93b9-33268fe76aa5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:35.752242 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5a0f3a32-84e4-42f7-93b9-33268fe76aa5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1266 microversion: 2.1 time: 0.156420 Nov 08 16:13:35.752800 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 277/562] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:35 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:35.861873 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d2e8c44e-b3d8-4c6a-87b5-3548e43e7155 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:35.862479 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d2e8c44e-b3d8-4c6a-87b5-3548e43e7155 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:35.868223 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d2e8c44e-b3d8-4c6a-87b5-3548e43e7155 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:35.868661 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d2e8c44e-b3d8-4c6a-87b5-3548e43e7155 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:35.869425 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d2e8c44e-b3d8-4c6a-87b5-3548e43e7155 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:35.869883 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d2e8c44e-b3d8-4c6a-87b5-3548e43e7155 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:35.934163 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3e5a4fe7-f850-4614-903b-5a1561101ed1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28437 microversion: 2.1 time: 0.246794 Nov 08 16:13:35.935061 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 286/563] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:35 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28437 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:13:36.019646 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d2e8c44e-b3d8-4c6a-87b5-3548e43e7155 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:36.028358 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d2e8c44e-b3d8-4c6a-87b5-3548e43e7155 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1318 microversion: 2.1 time: 0.170198 Nov 08 16:13:36.029563 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 278/564] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:35 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:36.034535 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-36c4b10f-f4f3-45c9-acf4-052f8700c15f req-222cfe80-ff7a-436f-8294-275229ea90f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d643b8f8-c205-49ba-8889-30842481b95f", "name": "network-vif-plugged", "status": "completed", "tag": "17d7004d-111e-4cfc-904c-a17ed005bc2f"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:36.036002 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:13:36.036002 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:13:36.043527 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-36c4b10f-f4f3-45c9-acf4-052f8700c15f req-222cfe80-ff7a-436f-8294-275229ea90f9 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:36.043980 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-36c4b10f-f4f3-45c9-acf4-052f8700c15f req-222cfe80-ff7a-436f-8294-275229ea90f9 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:36.057326 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-36c4b10f-f4f3-45c9-acf4-052f8700c15f req-222cfe80-ff7a-436f-8294-275229ea90f9 service nova] Creating event network-vif-plugged:17d7004d-111e-4cfc-904c-a17ed005bc2f for instance d643b8f8-c205-49ba-8889-30842481b95f on hv-cinder-81618 Nov 08 16:13:36.062688 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-36c4b10f-f4f3-45c9-acf4-052f8700c15f req-222cfe80-ff7a-436f-8294-275229ea90f9 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031955 Nov 08 16:13:36.063467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 287/565] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:13:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:13:36.110678 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-73ded72a-2f5e-478a-89ec-797fed3dbb94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:36.111498 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-73ded72a-2f5e-478a-89ec-797fed3dbb94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:36.119643 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-73ded72a-2f5e-478a-89ec-797fed3dbb94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:36.120107 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-73ded72a-2f5e-478a-89ec-797fed3dbb94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:36.120869 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-73ded72a-2f5e-478a-89ec-797fed3dbb94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:36.121288 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-73ded72a-2f5e-478a-89ec-797fed3dbb94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:36.175606 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ad938d79-5758-478d-a7c3-a17bba4b7388 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:36.176286 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ad938d79-5758-478d-a7c3-a17bba4b7388 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:36.184314 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad938d79-5758-478d-a7c3-a17bba4b7388 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:36.184755 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad938d79-5758-478d-a7c3-a17bba4b7388 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:36.185527 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad938d79-5758-478d-a7c3-a17bba4b7388 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:36.185977 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad938d79-5758-478d-a7c3-a17bba4b7388 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:36.316942 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-ad938d79-5758-478d-a7c3-a17bba4b7388 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:36.324179 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ad938d79-5758-478d-a7c3-a17bba4b7388 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.152556 Nov 08 16:13:36.324740 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 288/566] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:36 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:36.362364 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-73ded72a-2f5e-478a-89ec-797fed3dbb94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28461 microversion: 2.20 time: 0.255333 Nov 08 16:13:36.363487 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 279/567] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:36 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28461 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:36.669508 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-71ce8bab-f963-4477-96f5-fc51b6935f89 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:36.670467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-71ce8bab-f963-4477-96f5-fc51b6935f89 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:36.676787 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-71ce8bab-f963-4477-96f5-fc51b6935f89 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:36.677242 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-71ce8bab-f963-4477-96f5-fc51b6935f89 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:36.678054 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-71ce8bab-f963-4477-96f5-fc51b6935f89 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:36.678491 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-71ce8bab-f963-4477-96f5-fc51b6935f89 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:36.703719 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.objects.instance [None req-71ce8bab-f963-4477-96f5-fc51b6935f89 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lazy-loading 'flavor' on Instance uuid 44f7e3a8-0064-42ad-9e41-03a1ba050703 {{(pid=115524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:13:36.775196 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c51b2174-bff9-4aab-af2b-16911f11a654 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:36.775987 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c51b2174-bff9-4aab-af2b-16911f11a654 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:36.783093 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c51b2174-bff9-4aab-af2b-16911f11a654 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:36.783602 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c51b2174-bff9-4aab-af2b-16911f11a654 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:36.784391 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c51b2174-bff9-4aab-af2b-16911f11a654 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:36.784868 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c51b2174-bff9-4aab-af2b-16911f11a654 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:36.829175 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-71ce8bab-f963-4477-96f5-fc51b6935f89 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "POST /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/action" status: 200 len: 32 microversion: 2.1 time: 0.163194 Nov 08 16:13:36.829866 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 289/568] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:36 2021] POST /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 08 16:13:36.839570 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1e15db72-95b0-488d-b19d-1ce23dbc3bd1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:36.840264 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1e15db72-95b0-488d-b19d-1ce23dbc3bd1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:36.846378 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1e15db72-95b0-488d-b19d-1ce23dbc3bd1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:36.846833 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1e15db72-95b0-488d-b19d-1ce23dbc3bd1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:36.847612 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1e15db72-95b0-488d-b19d-1ce23dbc3bd1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:36.848049 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1e15db72-95b0-488d-b19d-1ce23dbc3bd1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:36.955157 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c51b2174-bff9-4aab-af2b-16911f11a654 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:36.963049 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c51b2174-bff9-4aab-af2b-16911f11a654 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1266 microversion: 2.1 time: 0.197085 Nov 08 16:13:36.972193 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 280/569] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:36 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:36.972193 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8df573d1-ed46-496f-b973-d35b3bada1e3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:36.972193 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8df573d1-ed46-496f-b973-d35b3bada1e3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:36.979005 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8df573d1-ed46-496f-b973-d35b3bada1e3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:36.979354 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8df573d1-ed46-496f-b973-d35b3bada1e3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:36.980275 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8df573d1-ed46-496f-b973-d35b3bada1e3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:36.980639 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8df573d1-ed46-496f-b973-d35b3bada1e3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:37.022716 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1e15db72-95b0-488d-b19d-1ce23dbc3bd1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:37.030524 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1e15db72-95b0-488d-b19d-1ce23dbc3bd1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.194918 Nov 08 16:13:37.031079 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 290/570] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:36 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:37.045204 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9649dd42-04d0-4564-9f5c-6d200a9c7878 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:37.045847 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9649dd42-04d0-4564-9f5c-6d200a9c7878 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:37.051724 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9649dd42-04d0-4564-9f5c-6d200a9c7878 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:37.052169 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9649dd42-04d0-4564-9f5c-6d200a9c7878 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:37.052946 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9649dd42-04d0-4564-9f5c-6d200a9c7878 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:37.053415 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9649dd42-04d0-4564-9f5c-6d200a9c7878 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:37.139932 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8df573d1-ed46-496f-b973-d35b3bada1e3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28437 microversion: 2.1 time: 0.174924 Nov 08 16:13:37.140772 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 281/571] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:36 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28437 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:37.182086 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-9649dd42-04d0-4564-9f5c-6d200a9c7878 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:37.190141 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9649dd42-04d0-4564-9f5c-6d200a9c7878 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1318 microversion: 2.1 time: 0.149234 Nov 08 16:13:37.190756 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 291/572] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:37 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:37.341346 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-dc0b2cec-fec4-421d-9201-21087727d6a1 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:37.342058 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-dc0b2cec-fec4-421d-9201-21087727d6a1 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:37.348905 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dc0b2cec-fec4-421d-9201-21087727d6a1 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:37.349348 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dc0b2cec-fec4-421d-9201-21087727d6a1 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:37.350189 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dc0b2cec-fec4-421d-9201-21087727d6a1 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:37.350626 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-dc0b2cec-fec4-421d-9201-21087727d6a1 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:37.375337 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-37626cf6-0e7d-4ea5-bfaa-cf4661dc691f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:37.376479 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-37626cf6-0e7d-4ea5-bfaa-cf4661dc691f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:37.383058 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-37626cf6-0e7d-4ea5-bfaa-cf4661dc691f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:37.383696 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-37626cf6-0e7d-4ea5-bfaa-cf4661dc691f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:37.384617 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-37626cf6-0e7d-4ea5-bfaa-cf4661dc691f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:37.385154 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-37626cf6-0e7d-4ea5-bfaa-cf4661dc691f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:37.471598 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-37626cf6-0e7d-4ea5-bfaa-cf4661dc691f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28461 microversion: 2.20 time: 0.100360 Nov 08 16:13:37.473046 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 292/573] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:37 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28461 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:13:37.487408 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-dc0b2cec-fec4-421d-9201-21087727d6a1 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:37.495088 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-dc0b2cec-fec4-421d-9201-21087727d6a1 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.157765 Nov 08 16:13:37.495647 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 282/574] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:37 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:37.980620 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-007d1dbd-0252-4c53-ada3-9df3c3a328e7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:37.981316 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-007d1dbd-0252-4c53-ada3-9df3c3a328e7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:37.988328 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-007d1dbd-0252-4c53-ada3-9df3c3a328e7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:37.988942 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-007d1dbd-0252-4c53-ada3-9df3c3a328e7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:37.990092 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-007d1dbd-0252-4c53-ada3-9df3c3a328e7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:37.990685 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-007d1dbd-0252-4c53-ada3-9df3c3a328e7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:38.047733 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-bf305f95-44c1-4042-83be-022b5d8ac12e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:38.048469 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-bf305f95-44c1-4042-83be-022b5d8ac12e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:38.055619 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bf305f95-44c1-4042-83be-022b5d8ac12e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:38.056066 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bf305f95-44c1-4042-83be-022b5d8ac12e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:38.056976 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bf305f95-44c1-4042-83be-022b5d8ac12e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:38.057375 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bf305f95-44c1-4042-83be-022b5d8ac12e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:38.169646 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-007d1dbd-0252-4c53-ada3-9df3c3a328e7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:38.177038 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-007d1dbd-0252-4c53-ada3-9df3c3a328e7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1266 microversion: 2.1 time: 0.200459 Nov 08 16:13:38.177616 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 293/575] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:37 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:38.182214 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-0fea6bc7-f417-4ab2-80d4-4d4025d67450 req-32b21b4d-8e99-4f15-b6a3-0c332d4de27b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf462447-a55a-46b8-9afd-afca942aa011", "name": "network-vif-plugged", "status": "completed", "tag": "f47160fc-9457-4c27-a7dc-b4b4b112f9b1"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:38.183730 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:13:38.183730 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:13:38.190398 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-0fea6bc7-f417-4ab2-80d4-4d4025d67450 req-32b21b4d-8e99-4f15-b6a3-0c332d4de27b service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:38.190840 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-0fea6bc7-f417-4ab2-80d4-4d4025d67450 req-32b21b4d-8e99-4f15-b6a3-0c332d4de27b service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:38.203197 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-0fea6bc7-f417-4ab2-80d4-4d4025d67450 req-32b21b4d-8e99-4f15-b6a3-0c332d4de27b service nova] Creating event network-vif-plugged:f47160fc-9457-4c27-a7dc-b4b4b112f9b1 for instance cf462447-a55a-46b8-9afd-afca942aa011 on hv-cinder-81618 Nov 08 16:13:38.208046 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-0fea6bc7-f417-4ab2-80d4-4d4025d67450 req-32b21b4d-8e99-4f15-b6a3-0c332d4de27b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029160 Nov 08 16:13:38.208641 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 294/576] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:13:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:13:38.214134 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-6b64f3f0-c4d4-4c60-a6af-d31188b8526b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:38.215163 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-6b64f3f0-c4d4-4c60-a6af-d31188b8526b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:38.221111 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6b64f3f0-c4d4-4c60-a6af-d31188b8526b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:38.221560 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6b64f3f0-c4d4-4c60-a6af-d31188b8526b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:38.222389 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6b64f3f0-c4d4-4c60-a6af-d31188b8526b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:38.222823 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6b64f3f0-c4d4-4c60-a6af-d31188b8526b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:38.237986 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-bf305f95-44c1-4042-83be-022b5d8ac12e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:38.246465 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-bf305f95-44c1-4042-83be-022b5d8ac12e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.202408 Nov 08 16:13:38.247038 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 283/577] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:38 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:38.251733 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-83912ed1-4282-4f55-a15c-308e775d8939 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:38.252328 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-83912ed1-4282-4f55-a15c-308e775d8939 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:38.258194 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-83912ed1-4282-4f55-a15c-308e775d8939 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:38.258641 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-83912ed1-4282-4f55-a15c-308e775d8939 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:38.259414 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-83912ed1-4282-4f55-a15c-308e775d8939 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:38.259841 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-83912ed1-4282-4f55-a15c-308e775d8939 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:38.376177 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-6b64f3f0-c4d4-4c60-a6af-d31188b8526b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.166103 Nov 08 16:13:38.377084 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 295/578] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:38 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:38.395974 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-83912ed1-4282-4f55-a15c-308e775d8939 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:38.403703 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-83912ed1-4282-4f55-a15c-308e775d8939 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1318 microversion: 2.1 time: 0.155484 Nov 08 16:13:38.404263 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 284/579] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:38 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:38.484644 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-54a8057f-6cde-486a-bd63-3f06d6645d85 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:38.485646 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-54a8057f-6cde-486a-bd63-3f06d6645d85 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:38.492653 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-54a8057f-6cde-486a-bd63-3f06d6645d85 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:38.493133 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-54a8057f-6cde-486a-bd63-3f06d6645d85 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:38.493938 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-54a8057f-6cde-486a-bd63-3f06d6645d85 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:38.494374 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-54a8057f-6cde-486a-bd63-3f06d6645d85 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:38.511550 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5a1da838-a50b-498a-9252-65cf221133ad tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:38.512141 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5a1da838-a50b-498a-9252-65cf221133ad tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:38.517792 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5a1da838-a50b-498a-9252-65cf221133ad tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:38.518228 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5a1da838-a50b-498a-9252-65cf221133ad tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:38.518983 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5a1da838-a50b-498a-9252-65cf221133ad tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:38.519404 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5a1da838-a50b-498a-9252-65cf221133ad tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:38.651618 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-5a1da838-a50b-498a-9252-65cf221133ad tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:38.659907 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5a1da838-a50b-498a-9252-65cf221133ad tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.151926 Nov 08 16:13:38.660474 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 285/580] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:38 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:39.011982 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-54a8057f-6cde-486a-bd63-3f06d6645d85 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.531459 Nov 08 16:13:39.012635 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 296/581] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:38 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:39.192934 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-58aa1647-125b-4206-b916-f7933aa25750 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:39.194384 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-58aa1647-125b-4206-b916-f7933aa25750 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:39.201771 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-58aa1647-125b-4206-b916-f7933aa25750 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:39.202222 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-58aa1647-125b-4206-b916-f7933aa25750 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:39.203006 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-58aa1647-125b-4206-b916-f7933aa25750 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:39.203438 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-58aa1647-125b-4206-b916-f7933aa25750 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:39.263847 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4b94c3df-1291-4fc2-91b2-9165adfd908f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:39.264559 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4b94c3df-1291-4fc2-91b2-9165adfd908f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:39.271623 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b94c3df-1291-4fc2-91b2-9165adfd908f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:39.272068 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b94c3df-1291-4fc2-91b2-9165adfd908f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:39.272866 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b94c3df-1291-4fc2-91b2-9165adfd908f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:39.273304 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b94c3df-1291-4fc2-91b2-9165adfd908f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:39.364377 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-58aa1647-125b-4206-b916-f7933aa25750 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:39.373274 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-58aa1647-125b-4206-b916-f7933aa25750 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1454 microversion: 2.1 time: 0.183806 Nov 08 16:13:39.374187 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 286/582] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:39 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1454 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:39.387665 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f51c26d9-6f83-4f7f-a6b4-44b29ea11b5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:39.388622 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f51c26d9-6f83-4f7f-a6b4-44b29ea11b5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:39.394577 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f51c26d9-6f83-4f7f-a6b4-44b29ea11b5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:39.395016 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f51c26d9-6f83-4f7f-a6b4-44b29ea11b5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:39.395788 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f51c26d9-6f83-4f7f-a6b4-44b29ea11b5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:39.396209 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f51c26d9-6f83-4f7f-a6b4-44b29ea11b5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:39.431801 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4b94c3df-1291-4fc2-91b2-9165adfd908f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:39.439723 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4b94c3df-1291-4fc2-91b2-9165adfd908f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.179916 Nov 08 16:13:39.440353 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 297/583] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:39 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:39.444612 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-be408792-4aa8-401e-b6ae-8a7086772a02 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:39.445237 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-be408792-4aa8-401e-b6ae-8a7086772a02 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:39.450831 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-be408792-4aa8-401e-b6ae-8a7086772a02 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:39.451268 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-be408792-4aa8-401e-b6ae-8a7086772a02 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:39.452025 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-be408792-4aa8-401e-b6ae-8a7086772a02 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:39.452449 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-be408792-4aa8-401e-b6ae-8a7086772a02 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:39.504789 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f51c26d9-6f83-4f7f-a6b4-44b29ea11b5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.120728 Nov 08 16:13:39.505664 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 287/584] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:39 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:39.510389 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8f52fcee-14d2-420d-8dc8-6510bc04e57e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:39.511071 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8f52fcee-14d2-420d-8dc8-6510bc04e57e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:39.517154 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8f52fcee-14d2-420d-8dc8-6510bc04e57e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:39.517595 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8f52fcee-14d2-420d-8dc8-6510bc04e57e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:39.518389 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8f52fcee-14d2-420d-8dc8-6510bc04e57e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:39.518816 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8f52fcee-14d2-420d-8dc8-6510bc04e57e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:39.610351 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-be408792-4aa8-401e-b6ae-8a7086772a02 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:39.618435 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-be408792-4aa8-401e-b6ae-8a7086772a02 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1454 microversion: 2.1 time: 0.177117 Nov 08 16:13:39.619008 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 298/585] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:39 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1454 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:39.676131 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8f52fcee-14d2-420d-8dc8-6510bc04e57e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:39.676291 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-68ef52d0-c273-40cf-9562-21d7a5ebf4f2 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:39.676944 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-68ef52d0-c273-40cf-9562-21d7a5ebf4f2 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:39.682840 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-68ef52d0-c273-40cf-9562-21d7a5ebf4f2 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:39.683368 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-68ef52d0-c273-40cf-9562-21d7a5ebf4f2 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:39.683683 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8f52fcee-14d2-420d-8dc8-6510bc04e57e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1318 microversion: 2.1 time: 0.176945 Nov 08 16:13:39.684281 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-68ef52d0-c273-40cf-9562-21d7a5ebf4f2 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:39.684784 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-68ef52d0-c273-40cf-9562-21d7a5ebf4f2 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:39.685199 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 288/586] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:39 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:39.812923 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-68ef52d0-c273-40cf-9562-21d7a5ebf4f2 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:39.820460 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-68ef52d0-c273-40cf-9562-21d7a5ebf4f2 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.147948 Nov 08 16:13:39.821041 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 299/587] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:39 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:40.023722 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9c4115f2-988a-4d59-85f5-0f29cd254a41 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:40.024634 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-9c4115f2-988a-4d59-85f5-0f29cd254a41 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:40.030940 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9c4115f2-988a-4d59-85f5-0f29cd254a41 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:40.031378 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9c4115f2-988a-4d59-85f5-0f29cd254a41 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:40.032147 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9c4115f2-988a-4d59-85f5-0f29cd254a41 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:40.032572 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9c4115f2-988a-4d59-85f5-0f29cd254a41 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:40.456524 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2ff6a5cb-b6e1-497c-b23c-d299438a4def tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:40.458060 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2ff6a5cb-b6e1-497c-b23c-d299438a4def tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:40.465892 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2ff6a5cb-b6e1-497c-b23c-d299438a4def tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:40.466551 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2ff6a5cb-b6e1-497c-b23c-d299438a4def tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:40.467511 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2ff6a5cb-b6e1-497c-b23c-d299438a4def tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:40.468362 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2ff6a5cb-b6e1-497c-b23c-d299438a4def tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:40.612140 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-2ff6a5cb-b6e1-497c-b23c-d299438a4def tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:40.620997 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2ff6a5cb-b6e1-497c-b23c-d299438a4def tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.168502 Nov 08 16:13:40.621588 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 300/588] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:40 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:40.626785 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-78f0f823-2724-41b4-a2db-54dede2f03cb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:40.628155 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-78f0f823-2724-41b4-a2db-54dede2f03cb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:40.634627 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-78f0f823-2724-41b4-a2db-54dede2f03cb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:40.635277 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-78f0f823-2724-41b4-a2db-54dede2f03cb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:40.636064 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-78f0f823-2724-41b4-a2db-54dede2f03cb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:40.636612 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-78f0f823-2724-41b4-a2db-54dede2f03cb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:47.917475 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-9c4115f2-988a-4d59-85f5-0f29cd254a41 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 7.897795 Nov 08 16:13:47.920345 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 289/589] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:40 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 7899 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:47.924076 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5144005b-06ad-4cf0-a8cd-f772a5d750d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:47.924923 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5144005b-06ad-4cf0-a8cd-f772a5d750d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:47.932584 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5144005b-06ad-4cf0-a8cd-f772a5d750d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:47.932995 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5144005b-06ad-4cf0-a8cd-f772a5d750d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:47.933816 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5144005b-06ad-4cf0-a8cd-f772a5d750d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:47.934247 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5144005b-06ad-4cf0-a8cd-f772a5d750d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:47.996196 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-78f0f823-2724-41b4-a2db-54dede2f03cb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 7.373116 Nov 08 16:13:47.996851 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 301/590] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:40 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 7375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:48.002111 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-559dc660-66b2-46c2-9929-055a2b24ede8 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:48.002951 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-559dc660-66b2-46c2-9929-055a2b24ede8 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:48.012701 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-559dc660-66b2-46c2-9929-055a2b24ede8 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:48.013153 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-559dc660-66b2-46c2-9929-055a2b24ede8 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:48.013969 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-559dc660-66b2-46c2-9929-055a2b24ede8 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:48.014403 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-559dc660-66b2-46c2-9929-055a2b24ede8 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:48.090871 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-5144005b-06ad-4cf0-a8cd-f772a5d750d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:48.097979 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5144005b-06ad-4cf0-a8cd-f772a5d750d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1318 microversion: 2.1 time: 0.178693 Nov 08 16:13:48.098530 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 290/591] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:47 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:48.103548 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-92ba8d42-d305-40bd-8b5b-926c27fd933e req-d7d672a6-48e4-439b-a0c5-cd0a146e66c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d643b8f8-c205-49ba-8889-30842481b95f", "tag": "17d7004d-111e-4cfc-904c-a17ed005bc2f"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:48.105043 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:13:48.105043 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:13:48.115791 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-92ba8d42-d305-40bd-8b5b-926c27fd933e req-d7d672a6-48e4-439b-a0c5-cd0a146e66c4 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:48.116286 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-92ba8d42-d305-40bd-8b5b-926c27fd933e req-d7d672a6-48e4-439b-a0c5-cd0a146e66c4 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:48.127593 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-92ba8d42-d305-40bd-8b5b-926c27fd933e req-d7d672a6-48e4-439b-a0c5-cd0a146e66c4 service nova] Creating event network-changed:17d7004d-111e-4cfc-904c-a17ed005bc2f for instance d643b8f8-c205-49ba-8889-30842481b95f on hv-cinder-81618 Nov 08 16:13:48.132518 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-92ba8d42-d305-40bd-8b5b-926c27fd933e req-d7d672a6-48e4-439b-a0c5-cd0a146e66c4 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032902 Nov 08 16:13:48.133088 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 291/592] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:13:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:13:48.138047 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a7cb10ec-19ed-4d93-b120-740ff4c61597 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:48.138722 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a7cb10ec-19ed-4d93-b120-740ff4c61597 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:48.144407 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a7cb10ec-19ed-4d93-b120-740ff4c61597 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:48.144844 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a7cb10ec-19ed-4d93-b120-740ff4c61597 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:48.145603 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a7cb10ec-19ed-4d93-b120-740ff4c61597 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:48.146054 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a7cb10ec-19ed-4d93-b120-740ff4c61597 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:48.165338 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-559dc660-66b2-46c2-9929-055a2b24ede8 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:48.172460 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-559dc660-66b2-46c2-9929-055a2b24ede8 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.174495 Nov 08 16:13:48.173011 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 302/593] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:47 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:48.273378 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a7cb10ec-19ed-4d93-b120-740ff4c61597 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:48.281964 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a7cb10ec-19ed-4d93-b120-740ff4c61597 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.147594 Nov 08 16:13:48.282687 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 292/594] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:48 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:48.929906 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-816bbf56-513e-4b67-9df0-53bd4e3271e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:48.930869 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-816bbf56-513e-4b67-9df0-53bd4e3271e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:48.937441 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-816bbf56-513e-4b67-9df0-53bd4e3271e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:48.937980 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-816bbf56-513e-4b67-9df0-53bd4e3271e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:48.938787 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-816bbf56-513e-4b67-9df0-53bd4e3271e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:48.939192 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-816bbf56-513e-4b67-9df0-53bd4e3271e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:49.007533 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-36615d0a-ffc4-4f41-a447-b32434eb60bb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:49.008458 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-36615d0a-ffc4-4f41-a447-b32434eb60bb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:49.015197 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-36615d0a-ffc4-4f41-a447-b32434eb60bb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:49.015948 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-36615d0a-ffc4-4f41-a447-b32434eb60bb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:49.017187 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-36615d0a-ffc4-4f41-a447-b32434eb60bb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:49.018199 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-36615d0a-ffc4-4f41-a447-b32434eb60bb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:49.127159 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-816bbf56-513e-4b67-9df0-53bd4e3271e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.201270 Nov 08 16:13:49.127797 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 303/595] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:48 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:13:49.131317 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-36615d0a-ffc4-4f41-a447-b32434eb60bb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.127110 Nov 08 16:13:49.131317 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 293/596] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:49 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:13:49.132591 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-8f27edf1-f683-4f4d-92a8-6d45abf7d3d0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:49.133270 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-8f27edf1-f683-4f4d-92a8-6d45abf7d3d0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:49.140084 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8f27edf1-f683-4f4d-92a8-6d45abf7d3d0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:49.140520 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8f27edf1-f683-4f4d-92a8-6d45abf7d3d0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:49.141280 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8f27edf1-f683-4f4d-92a8-6d45abf7d3d0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:49.141733 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8f27edf1-f683-4f4d-92a8-6d45abf7d3d0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:49.192149 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-58c65807-7608-4ecd-8d29-a333277a938f tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:49.192861 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-58c65807-7608-4ecd-8d29-a333277a938f tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:49.199684 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-58c65807-7608-4ecd-8d29-a333277a938f tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:49.200128 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-58c65807-7608-4ecd-8d29-a333277a938f tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:49.200915 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-58c65807-7608-4ecd-8d29-a333277a938f tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:49.201332 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-58c65807-7608-4ecd-8d29-a333277a938f tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:49.511098 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-8f27edf1-f683-4f4d-92a8-6d45abf7d3d0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:49.518211 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-8f27edf1-f683-4f4d-92a8-6d45abf7d3d0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1318 microversion: 2.1 time: 0.389312 Nov 08 16:13:49.518777 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 304/597] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:49 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:49.523596 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4cd8710d-970a-4f55-8f8e-e3053b3a33f5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:49.524200 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4cd8710d-970a-4f55-8f8e-e3053b3a33f5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:49.529820 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4cd8710d-970a-4f55-8f8e-e3053b3a33f5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:49.530268 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4cd8710d-970a-4f55-8f8e-e3053b3a33f5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:49.531043 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4cd8710d-970a-4f55-8f8e-e3053b3a33f5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:49.531471 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4cd8710d-970a-4f55-8f8e-e3053b3a33f5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:49.579082 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-58c65807-7608-4ecd-8d29-a333277a938f tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:49.586769 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-58c65807-7608-4ecd-8d29-a333277a938f tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.401974 Nov 08 16:13:49.587332 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 294/598] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:49 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:49.668009 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4cd8710d-970a-4f55-8f8e-e3053b3a33f5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:49.675633 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4cd8710d-970a-4f55-8f8e-e3053b3a33f5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.155922 Nov 08 16:13:49.676191 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 305/599] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:49 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:50.139278 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-894aa0c4-6155-4d9a-9bce-eef9a835ed50 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:50.140198 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-894aa0c4-6155-4d9a-9bce-eef9a835ed50 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:50.141282 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e2dde175-1e23-4222-8177-cdc7b561cae2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:50.142266 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e2dde175-1e23-4222-8177-cdc7b561cae2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:50.146230 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-894aa0c4-6155-4d9a-9bce-eef9a835ed50 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:50.147210 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-894aa0c4-6155-4d9a-9bce-eef9a835ed50 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:50.147982 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-894aa0c4-6155-4d9a-9bce-eef9a835ed50 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:50.148408 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-894aa0c4-6155-4d9a-9bce-eef9a835ed50 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:50.148500 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e2dde175-1e23-4222-8177-cdc7b561cae2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:50.148900 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e2dde175-1e23-4222-8177-cdc7b561cae2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:50.149662 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e2dde175-1e23-4222-8177-cdc7b561cae2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:50.150330 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e2dde175-1e23-4222-8177-cdc7b561cae2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:50.270758 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e2dde175-1e23-4222-8177-cdc7b561cae2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.132824 Nov 08 16:13:50.271902 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 306/600] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:50 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:13:50.276500 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-894aa0c4-6155-4d9a-9bce-eef9a835ed50 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.141001 Nov 08 16:13:50.277134 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 295/601] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:50 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:50.534849 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-fe52810f-59c8-4339-8dca-5f329b5ff33e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:50.535532 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-fe52810f-59c8-4339-8dca-5f329b5ff33e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:50.542754 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fe52810f-59c8-4339-8dca-5f329b5ff33e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:50.543194 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fe52810f-59c8-4339-8dca-5f329b5ff33e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:50.543961 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fe52810f-59c8-4339-8dca-5f329b5ff33e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:50.544514 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fe52810f-59c8-4339-8dca-5f329b5ff33e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:50.603595 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0e8af8cf-0d7a-4fc0-8298-f09d04375f5d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:50.604295 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0e8af8cf-0d7a-4fc0-8298-f09d04375f5d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:50.611117 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0e8af8cf-0d7a-4fc0-8298-f09d04375f5d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:50.611536 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0e8af8cf-0d7a-4fc0-8298-f09d04375f5d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:50.612296 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0e8af8cf-0d7a-4fc0-8298-f09d04375f5d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:50.612716 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0e8af8cf-0d7a-4fc0-8298-f09d04375f5d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:50.700177 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-fe52810f-59c8-4339-8dca-5f329b5ff33e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:50.707480 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-fe52810f-59c8-4339-8dca-5f329b5ff33e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1318 microversion: 2.1 time: 0.176536 Nov 08 16:13:50.708040 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 307/602] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:50 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:50.712830 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-31ca1fb8-76e1-48c5-a77c-e525ae13955e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:50.713423 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-31ca1fb8-76e1-48c5-a77c-e525ae13955e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:50.719057 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-31ca1fb8-76e1-48c5-a77c-e525ae13955e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:50.719505 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-31ca1fb8-76e1-48c5-a77c-e525ae13955e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:50.720275 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-31ca1fb8-76e1-48c5-a77c-e525ae13955e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:50.720707 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-31ca1fb8-76e1-48c5-a77c-e525ae13955e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:50.772628 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0e8af8cf-0d7a-4fc0-8298-f09d04375f5d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:50.779825 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0e8af8cf-0d7a-4fc0-8298-f09d04375f5d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.180151 Nov 08 16:13:50.780386 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 296/603] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:50 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:50.856513 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-31ca1fb8-76e1-48c5-a77c-e525ae13955e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:50.864221 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-31ca1fb8-76e1-48c5-a77c-e525ae13955e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.155255 Nov 08 16:13:50.864774 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 308/604] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:50 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:51.282150 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-01fbb414-a7f9-43f6-812b-d724ca5b54c9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:51.283082 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-01fbb414-a7f9-43f6-812b-d724ca5b54c9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:51.286756 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c1952f49-4355-4746-b30c-fb6f44bdc677 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:51.288160 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c1952f49-4355-4746-b30c-fb6f44bdc677 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:51.289926 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-01fbb414-a7f9-43f6-812b-d724ca5b54c9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:51.290362 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-01fbb414-a7f9-43f6-812b-d724ca5b54c9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:51.291124 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-01fbb414-a7f9-43f6-812b-d724ca5b54c9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:51.291545 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-01fbb414-a7f9-43f6-812b-d724ca5b54c9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:51.294354 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c1952f49-4355-4746-b30c-fb6f44bdc677 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:51.294809 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c1952f49-4355-4746-b30c-fb6f44bdc677 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:51.295576 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c1952f49-4355-4746-b30c-fb6f44bdc677 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:51.296015 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c1952f49-4355-4746-b30c-fb6f44bdc677 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:51.576559 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c1952f49-4355-4746-b30c-fb6f44bdc677 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.293296 Nov 08 16:13:51.577383 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 309/605] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:51 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:13:51.585175 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-01fbb414-a7f9-43f6-812b-d724ca5b54c9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.306471 Nov 08 16:13:51.585833 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 297/606] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:51 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:51.725423 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b2f864c1-001b-43ef-b2d1-33da44d396b8 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:51.726060 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b2f864c1-001b-43ef-b2d1-33da44d396b8 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:51.732819 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b2f864c1-001b-43ef-b2d1-33da44d396b8 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:51.733257 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b2f864c1-001b-43ef-b2d1-33da44d396b8 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:51.734043 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b2f864c1-001b-43ef-b2d1-33da44d396b8 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:51.734466 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b2f864c1-001b-43ef-b2d1-33da44d396b8 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:51.796862 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-35a35804-3c2a-44e9-969b-2982b2e6bf1a tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:51.797544 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-35a35804-3c2a-44e9-969b-2982b2e6bf1a tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:51.805128 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-35a35804-3c2a-44e9-969b-2982b2e6bf1a tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:51.805878 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-35a35804-3c2a-44e9-969b-2982b2e6bf1a tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:51.807044 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-35a35804-3c2a-44e9-969b-2982b2e6bf1a tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:51.807529 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-35a35804-3c2a-44e9-969b-2982b2e6bf1a tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:51.887369 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b2f864c1-001b-43ef-b2d1-33da44d396b8 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:51.894599 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b2f864c1-001b-43ef-b2d1-33da44d396b8 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1508 microversion: 2.1 time: 0.173922 Nov 08 16:13:51.895464 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 310/607] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:51 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:51.899728 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5724ec58-ce0c-4e62-870b-fe877cf33896 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:51.900317 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5724ec58-ce0c-4e62-870b-fe877cf33896 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:51.906183 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5724ec58-ce0c-4e62-870b-fe877cf33896 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:51.906625 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5724ec58-ce0c-4e62-870b-fe877cf33896 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:51.907387 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5724ec58-ce0c-4e62-870b-fe877cf33896 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:51.907814 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5724ec58-ce0c-4e62-870b-fe877cf33896 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:51.991467 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-35a35804-3c2a-44e9-969b-2982b2e6bf1a tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:52.004825 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-35a35804-3c2a-44e9-969b-2982b2e6bf1a tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.209980 Nov 08 16:13:52.006809 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 298/608] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:51 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:52.071530 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-5724ec58-ce0c-4e62-870b-fe877cf33896 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:52.086267 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5724ec58-ce0c-4e62-870b-fe877cf33896 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.189539 Nov 08 16:13:52.087388 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 311/609] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:51 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:52.142075 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-cf29ed55-880e-4c84-935e-b668ee285a4c req-e64b1dad-eaf2-4d15-a572-8de733417af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e5636f-2ecf-4438-8be2-e973029678a1", "name": "network-vif-plugged", "status": "completed", "tag": "2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:52.143841 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:13:52.143841 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:13:52.151944 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-cf29ed55-880e-4c84-935e-b668ee285a4c req-e64b1dad-eaf2-4d15-a572-8de733417af5 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:52.152305 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-cf29ed55-880e-4c84-935e-b668ee285a4c req-e64b1dad-eaf2-4d15-a572-8de733417af5 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:52.163328 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-cf29ed55-880e-4c84-935e-b668ee285a4c req-e64b1dad-eaf2-4d15-a572-8de733417af5 service nova] Creating event network-vif-plugged:2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e for instance 37e5636f-2ecf-4438-8be2-e973029678a1 on hv-cinder-81618 Nov 08 16:13:52.168274 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-cf29ed55-880e-4c84-935e-b668ee285a4c req-e64b1dad-eaf2-4d15-a572-8de733417af5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029821 Nov 08 16:13:52.169165 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 299/610] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:13:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:13:52.588295 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a7802736-437c-4e3e-b0a3-1f520e881113 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:52.589545 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a7802736-437c-4e3e-b0a3-1f520e881113 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:52.596457 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a7802736-437c-4e3e-b0a3-1f520e881113 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:52.596658 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-2aaa88ed-ab31-4669-a8e6-66fac088b56d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:52.597085 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a7802736-437c-4e3e-b0a3-1f520e881113 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:52.597642 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a7802736-437c-4e3e-b0a3-1f520e881113 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:52.597769 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-2aaa88ed-ab31-4669-a8e6-66fac088b56d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:52.598092 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a7802736-437c-4e3e-b0a3-1f520e881113 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:52.604093 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2aaa88ed-ab31-4669-a8e6-66fac088b56d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:52.604537 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2aaa88ed-ab31-4669-a8e6-66fac088b56d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:52.605305 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2aaa88ed-ab31-4669-a8e6-66fac088b56d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:52.605752 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2aaa88ed-ab31-4669-a8e6-66fac088b56d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:52.858952 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a7802736-437c-4e3e-b0a3-1f520e881113 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.274220 Nov 08 16:13:52.859587 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 312/611] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:52 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:52.867889 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-2aaa88ed-ab31-4669-a8e6-66fac088b56d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.274976 Nov 08 16:13:52.868512 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 300/612] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:52 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:13:53.023915 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d6248765-6f55-45de-8567-c56904c29b96 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:53.024606 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d6248765-6f55-45de-8567-c56904c29b96 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:53.031585 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d6248765-6f55-45de-8567-c56904c29b96 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:53.032027 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d6248765-6f55-45de-8567-c56904c29b96 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:53.032790 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d6248765-6f55-45de-8567-c56904c29b96 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:53.033212 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d6248765-6f55-45de-8567-c56904c29b96 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:53.104075 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-2d4e919a-607c-4862-8284-1b0c23c72058 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:53.104760 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-2d4e919a-607c-4862-8284-1b0c23c72058 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:53.112186 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2d4e919a-607c-4862-8284-1b0c23c72058 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:53.112186 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2d4e919a-607c-4862-8284-1b0c23c72058 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:53.112884 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2d4e919a-607c-4862-8284-1b0c23c72058 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:53.113369 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2d4e919a-607c-4862-8284-1b0c23c72058 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:53.184836 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-d6248765-6f55-45de-8567-c56904c29b96 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:53.192237 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d6248765-6f55-45de-8567-c56904c29b96 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.172334 Nov 08 16:13:53.192800 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 313/613] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:53 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:53.254261 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-2d4e919a-607c-4862-8284-1b0c23c72058 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:53.261929 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-2d4e919a-607c-4862-8284-1b0c23c72058 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.162373 Nov 08 16:13:53.262479 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 301/614] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:53 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:53.871159 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-32940ea5-f2fe-425f-b1bf-01f67e88f4ef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:53.872169 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-32940ea5-f2fe-425f-b1bf-01f67e88f4ef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:53.878838 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-32940ea5-f2fe-425f-b1bf-01f67e88f4ef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:53.879304 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-32940ea5-f2fe-425f-b1bf-01f67e88f4ef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:53.879422 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-bbf6499f-7804-42e1-b70b-1521b766371b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:53.880064 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-32940ea5-f2fe-425f-b1bf-01f67e88f4ef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:53.880291 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-bbf6499f-7804-42e1-b70b-1521b766371b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:53.880494 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-32940ea5-f2fe-425f-b1bf-01f67e88f4ef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:53.887256 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bbf6499f-7804-42e1-b70b-1521b766371b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:53.887701 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bbf6499f-7804-42e1-b70b-1521b766371b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:53.888480 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bbf6499f-7804-42e1-b70b-1521b766371b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:53.888907 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bbf6499f-7804-42e1-b70b-1521b766371b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:54.006652 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-32940ea5-f2fe-425f-b1bf-01f67e88f4ef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.138829 Nov 08 16:13:54.010991 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 314/615] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:53 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:54.011147 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-bbf6499f-7804-42e1-b70b-1521b766371b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.134892 Nov 08 16:13:54.011610 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 302/616] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:53 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:13:54.208630 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-6473b7b3-8455-46e0-bf64-a373dd219dbb tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:54.209354 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-6473b7b3-8455-46e0-bf64-a373dd219dbb tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:54.216283 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6473b7b3-8455-46e0-bf64-a373dd219dbb tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:54.216733 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6473b7b3-8455-46e0-bf64-a373dd219dbb tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:54.217500 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6473b7b3-8455-46e0-bf64-a373dd219dbb tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:54.217971 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6473b7b3-8455-46e0-bf64-a373dd219dbb tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:54.279899 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d4a42b06-ebd6-4d79-bbf4-f9e63564a819 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:54.280581 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d4a42b06-ebd6-4d79-bbf4-f9e63564a819 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:54.287903 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d4a42b06-ebd6-4d79-bbf4-f9e63564a819 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:54.288345 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d4a42b06-ebd6-4d79-bbf4-f9e63564a819 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:54.289108 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d4a42b06-ebd6-4d79-bbf4-f9e63564a819 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:54.289539 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d4a42b06-ebd6-4d79-bbf4-f9e63564a819 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:54.372283 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-6473b7b3-8455-46e0-bf64-a373dd219dbb tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:54.380610 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-6473b7b3-8455-46e0-bf64-a373dd219dbb tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.175893 Nov 08 16:13:54.381401 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 315/617] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:54 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:54.404291 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d3eba270-08a4-419e-bad7-45a913d4e471 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "059fb8b5-0319-4b35-9351-6d7fefe4270d"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:54.405348 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d3eba270-08a4-419e-bad7-45a913d4e471 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:54.411140 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d3eba270-08a4-419e-bad7-45a913d4e471 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:54.411590 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d3eba270-08a4-419e-bad7-45a913d4e471 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:54.412914 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d3eba270-08a4-419e-bad7-45a913d4e471 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:54.413347 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d3eba270-08a4-419e-bad7-45a913d4e471 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:54.441889 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d4a42b06-ebd6-4d79-bbf4-f9e63564a819 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:54.449679 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d4a42b06-ebd6-4d79-bbf4-f9e63564a819 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.173873 Nov 08 16:13:54.450259 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 303/618] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:54 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:54.640417 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d3eba270-08a4-419e-bad7-45a913d4e471 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "POST /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239648 Nov 08 16:13:54.641196 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 316/619] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Nov 8 16:13:54 2021] POST /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:13:55.018454 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6d19f1bc-0997-4eec-818f-3b1e8dd62876 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:55.019460 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6d19f1bc-0997-4eec-818f-3b1e8dd62876 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:55.023537 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7a70b613-7958-4881-860c-b80ad723c14d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:55.024573 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7a70b613-7958-4881-860c-b80ad723c14d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:55.026735 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6d19f1bc-0997-4eec-818f-3b1e8dd62876 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:55.027180 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6d19f1bc-0997-4eec-818f-3b1e8dd62876 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:55.027947 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6d19f1bc-0997-4eec-818f-3b1e8dd62876 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:55.028375 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6d19f1bc-0997-4eec-818f-3b1e8dd62876 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:55.032125 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7a70b613-7958-4881-860c-b80ad723c14d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:55.032651 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7a70b613-7958-4881-860c-b80ad723c14d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:55.033850 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7a70b613-7958-4881-860c-b80ad723c14d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:55.034365 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7a70b613-7958-4881-860c-b80ad723c14d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:55.150248 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6d19f1bc-0997-4eec-818f-3b1e8dd62876 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.134038 Nov 08 16:13:55.154395 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 304/620] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:55 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:55.162241 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7a70b613-7958-4881-860c-b80ad723c14d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.143394 Nov 08 16:13:55.162878 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 317/621] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:55 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:13:55.398001 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-73ad7988-8508-45e2-ab22-f3378e5cdd6e tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:55.398854 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-73ad7988-8508-45e2-ab22-f3378e5cdd6e tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:55.405473 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-73ad7988-8508-45e2-ab22-f3378e5cdd6e tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:55.405973 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-73ad7988-8508-45e2-ab22-f3378e5cdd6e tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:55.406759 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-73ad7988-8508-45e2-ab22-f3378e5cdd6e tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:55.407190 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-73ad7988-8508-45e2-ab22-f3378e5cdd6e tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:55.466461 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1262f237-ae49-460e-9545-148beef71cd4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:55.467078 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1262f237-ae49-460e-9545-148beef71cd4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:55.473946 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1262f237-ae49-460e-9545-148beef71cd4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:55.474998 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1262f237-ae49-460e-9545-148beef71cd4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:55.475786 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1262f237-ae49-460e-9545-148beef71cd4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:55.476219 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1262f237-ae49-460e-9545-148beef71cd4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:55.613155 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-73ad7988-8508-45e2-ab22-f3378e5cdd6e tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:55.621572 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-73ad7988-8508-45e2-ab22-f3378e5cdd6e tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.228452 Nov 08 16:13:55.622241 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 305/622] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:55 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:55.681948 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1262f237-ae49-460e-9545-148beef71cd4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:55.689727 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1262f237-ae49-460e-9545-148beef71cd4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.227372 Nov 08 16:13:55.691429 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 318/623] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:55 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:56.165943 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-bac5009b-1b8c-417f-a2d1-7d9d3b3639b7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:56.166852 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-bac5009b-1b8c-417f-a2d1-7d9d3b3639b7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:56.173743 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bac5009b-1b8c-417f-a2d1-7d9d3b3639b7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:56.174199 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bac5009b-1b8c-417f-a2d1-7d9d3b3639b7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:56.174976 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bac5009b-1b8c-417f-a2d1-7d9d3b3639b7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:56.175375 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-252ff55e-2652-4bf3-a38e-e6c904a7f66b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:56.175837 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bac5009b-1b8c-417f-a2d1-7d9d3b3639b7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:56.176547 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-252ff55e-2652-4bf3-a38e-e6c904a7f66b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:56.186144 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-252ff55e-2652-4bf3-a38e-e6c904a7f66b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:56.186677 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-252ff55e-2652-4bf3-a38e-e6c904a7f66b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:56.187806 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-252ff55e-2652-4bf3-a38e-e6c904a7f66b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:56.188568 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-252ff55e-2652-4bf3-a38e-e6c904a7f66b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:56.250235 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-bac5009b-1b8c-417f-a2d1-7d9d3b3639b7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.088788 Nov 08 16:13:56.254749 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 306/624] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:56 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:56.256384 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-252ff55e-2652-4bf3-a38e-e6c904a7f66b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.085627 Nov 08 16:13:56.260248 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 319/625] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:56 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:56.639533 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b32b1ed7-8eda-4269-b4de-a173fc2e2497 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:56.640246 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b32b1ed7-8eda-4269-b4de-a173fc2e2497 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:56.647441 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b32b1ed7-8eda-4269-b4de-a173fc2e2497 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:56.647874 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b32b1ed7-8eda-4269-b4de-a173fc2e2497 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:56.648641 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b32b1ed7-8eda-4269-b4de-a173fc2e2497 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:56.649150 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b32b1ed7-8eda-4269-b4de-a173fc2e2497 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:56.705893 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-262a4197-eb74-4a54-a50d-eedbb6f5d42f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:56.706577 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-262a4197-eb74-4a54-a50d-eedbb6f5d42f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:56.714280 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-262a4197-eb74-4a54-a50d-eedbb6f5d42f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:56.714720 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-262a4197-eb74-4a54-a50d-eedbb6f5d42f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:56.715486 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-262a4197-eb74-4a54-a50d-eedbb6f5d42f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:56.715911 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-262a4197-eb74-4a54-a50d-eedbb6f5d42f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:56.804973 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b32b1ed7-8eda-4269-b4de-a173fc2e2497 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:56.812439 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b32b1ed7-8eda-4269-b4de-a173fc2e2497 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.176874 Nov 08 16:13:56.813074 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 307/626] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:56 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:56.869243 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-262a4197-eb74-4a54-a50d-eedbb6f5d42f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:56.877121 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-262a4197-eb74-4a54-a50d-eedbb6f5d42f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.175301 Nov 08 16:13:56.877678 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 320/627] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:56 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:57.262496 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8125d261-7559-4d4a-aaf5-c1492f7aa435 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:57.263408 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8125d261-7559-4d4a-aaf5-c1492f7aa435 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:57.267510 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c9eb600a-371a-4ed2-95a8-4d8e6b9178ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:57.268420 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c9eb600a-371a-4ed2-95a8-4d8e6b9178ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:57.269840 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8125d261-7559-4d4a-aaf5-c1492f7aa435 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:57.270274 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8125d261-7559-4d4a-aaf5-c1492f7aa435 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:57.271053 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8125d261-7559-4d4a-aaf5-c1492f7aa435 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:57.271481 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8125d261-7559-4d4a-aaf5-c1492f7aa435 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:57.274620 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c9eb600a-371a-4ed2-95a8-4d8e6b9178ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:57.275064 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c9eb600a-371a-4ed2-95a8-4d8e6b9178ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:57.275846 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c9eb600a-371a-4ed2-95a8-4d8e6b9178ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:57.276261 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c9eb600a-371a-4ed2-95a8-4d8e6b9178ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:57.344256 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8125d261-7559-4d4a-aaf5-c1492f7aa435 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.085245 Nov 08 16:13:57.344794 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 308/628] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:57 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:57.357859 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c9eb600a-371a-4ed2-95a8-4d8e6b9178ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.093848 Nov 08 16:13:57.358499 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 321/629] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:57 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:13:57.830019 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-39f1041a-ac95-4033-9196-0792b0387f16 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:57.830731 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-39f1041a-ac95-4033-9196-0792b0387f16 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:57.837939 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-39f1041a-ac95-4033-9196-0792b0387f16 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:57.838379 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-39f1041a-ac95-4033-9196-0792b0387f16 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:57.839141 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-39f1041a-ac95-4033-9196-0792b0387f16 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:57.839584 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-39f1041a-ac95-4033-9196-0792b0387f16 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:57.894975 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9b64769e-2dab-44f0-9b49-954070fc6fe8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:57.895612 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9b64769e-2dab-44f0-9b49-954070fc6fe8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:57.903016 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9b64769e-2dab-44f0-9b49-954070fc6fe8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:57.903462 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9b64769e-2dab-44f0-9b49-954070fc6fe8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:57.904243 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9b64769e-2dab-44f0-9b49-954070fc6fe8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:57.904676 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9b64769e-2dab-44f0-9b49-954070fc6fe8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:57.996165 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-39f1041a-ac95-4033-9196-0792b0387f16 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:58.003756 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-39f1041a-ac95-4033-9196-0792b0387f16 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.177756 Nov 08 16:13:58.004358 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 309/630] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:57 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:58.057092 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-9b64769e-2dab-44f0-9b49-954070fc6fe8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:58.064735 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9b64769e-2dab-44f0-9b49-954070fc6fe8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.173873 Nov 08 16:13:58.065380 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 322/631] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:57 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:58.356168 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-72387404-c560-4ef4-a14e-99b0735af5b3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:58.357070 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-72387404-c560-4ef4-a14e-99b0735af5b3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:58.363447 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-72387404-c560-4ef4-a14e-99b0735af5b3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:58.363952 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-72387404-c560-4ef4-a14e-99b0735af5b3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:58.364714 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-72387404-c560-4ef4-a14e-99b0735af5b3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:58.365137 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-72387404-c560-4ef4-a14e-99b0735af5b3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:58.368484 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3c9de6de-46c0-4927-b33c-5ad31b8b018c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:58.369398 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3c9de6de-46c0-4927-b33c-5ad31b8b018c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:58.375857 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3c9de6de-46c0-4927-b33c-5ad31b8b018c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:58.376299 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3c9de6de-46c0-4927-b33c-5ad31b8b018c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:58.377151 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3c9de6de-46c0-4927-b33c-5ad31b8b018c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:58.377512 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3c9de6de-46c0-4927-b33c-5ad31b8b018c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:58.471973 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-72387404-c560-4ef4-a14e-99b0735af5b3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.119465 Nov 08 16:13:58.472606 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 310/632] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:58 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:13:58.483714 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3c9de6de-46c0-4927-b33c-5ad31b8b018c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.118660 Nov 08 16:13:58.484340 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 323/633] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:58 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:13:59.021424 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a04f6b87-b63f-4b98-a21e-8b7dc7a48d71 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:59.022723 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a04f6b87-b63f-4b98-a21e-8b7dc7a48d71 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:59.030669 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a04f6b87-b63f-4b98-a21e-8b7dc7a48d71 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:59.031132 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a04f6b87-b63f-4b98-a21e-8b7dc7a48d71 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:59.031896 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a04f6b87-b63f-4b98-a21e-8b7dc7a48d71 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:59.032324 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a04f6b87-b63f-4b98-a21e-8b7dc7a48d71 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:59.081787 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0d3773e2-2e85-44be-a743-1e0dd62a1be5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:13:59.082609 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0d3773e2-2e85-44be-a743-1e0dd62a1be5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:59.089599 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0d3773e2-2e85-44be-a743-1e0dd62a1be5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:59.090155 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0d3773e2-2e85-44be-a743-1e0dd62a1be5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:59.090990 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0d3773e2-2e85-44be-a743-1e0dd62a1be5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:59.091493 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0d3773e2-2e85-44be-a743-1e0dd62a1be5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:59.191886 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a04f6b87-b63f-4b98-a21e-8b7dc7a48d71 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:59.198998 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a04f6b87-b63f-4b98-a21e-8b7dc7a48d71 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.182363 Nov 08 16:13:59.199560 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 311/634] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:59 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:13:59.251593 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0d3773e2-2e85-44be-a743-1e0dd62a1be5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:13:59.259294 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0d3773e2-2e85-44be-a743-1e0dd62a1be5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.181532 Nov 08 16:13:59.259855 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 324/635] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:13:59 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:13:59.483501 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ee926596-083c-4499-b98a-98773d46b0a5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:59.484410 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ee926596-083c-4499-b98a-98773d46b0a5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:59.490877 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ee926596-083c-4499-b98a-98773d46b0a5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:59.491315 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ee926596-083c-4499-b98a-98773d46b0a5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:59.492082 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ee926596-083c-4499-b98a-98773d46b0a5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:59.492507 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ee926596-083c-4499-b98a-98773d46b0a5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:59.494790 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-15d7fcd6-65b0-4558-aaa1-cee9441eabdc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:13:59.495703 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-15d7fcd6-65b0-4558-aaa1-cee9441eabdc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:13:59.502136 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-15d7fcd6-65b0-4558-aaa1-cee9441eabdc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:59.502585 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-15d7fcd6-65b0-4558-aaa1-cee9441eabdc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:59.503357 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-15d7fcd6-65b0-4558-aaa1-cee9441eabdc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:13:59.503788 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-15d7fcd6-65b0-4558-aaa1-cee9441eabdc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:13:59.602693 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ee926596-083c-4499-b98a-98773d46b0a5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.122680 Nov 08 16:13:59.603235 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 312/636] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:13:59 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:13:59.613363 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-15d7fcd6-65b0-4558-aaa1-cee9441eabdc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.122040 Nov 08 16:13:59.614014 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 325/637] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:13:59 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:14:00.216092 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f9b00a1b-88fa-46b9-b178-d8d37a86f124 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:00.216706 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f9b00a1b-88fa-46b9-b178-d8d37a86f124 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:00.223518 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f9b00a1b-88fa-46b9-b178-d8d37a86f124 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:00.223960 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f9b00a1b-88fa-46b9-b178-d8d37a86f124 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:00.225330 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f9b00a1b-88fa-46b9-b178-d8d37a86f124 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:00.225790 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f9b00a1b-88fa-46b9-b178-d8d37a86f124 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:00.276984 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f60fd6ee-c550-4a39-bfbc-307a9e8d1168 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:00.277684 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f60fd6ee-c550-4a39-bfbc-307a9e8d1168 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:00.284899 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f60fd6ee-c550-4a39-bfbc-307a9e8d1168 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:00.285351 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f60fd6ee-c550-4a39-bfbc-307a9e8d1168 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:00.286202 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f60fd6ee-c550-4a39-bfbc-307a9e8d1168 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:00.287253 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f60fd6ee-c550-4a39-bfbc-307a9e8d1168 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:00.389524 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f9b00a1b-88fa-46b9-b178-d8d37a86f124 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:00.397379 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f9b00a1b-88fa-46b9-b178-d8d37a86f124 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.185329 Nov 08 16:14:00.397853 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 313/638] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:00 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:00.445478 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f60fd6ee-c550-4a39-bfbc-307a9e8d1168 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:00.453291 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f60fd6ee-c550-4a39-bfbc-307a9e8d1168 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.180412 Nov 08 16:14:00.453876 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 326/639] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:00 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:00.613927 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0ff03862-d849-4ed6-8fea-31d46ee035ed tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:00.614862 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0ff03862-d849-4ed6-8fea-31d46ee035ed tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:00.621030 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0ff03862-d849-4ed6-8fea-31d46ee035ed tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:00.621472 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0ff03862-d849-4ed6-8fea-31d46ee035ed tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:00.622283 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0ff03862-d849-4ed6-8fea-31d46ee035ed tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:00.622975 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0ff03862-d849-4ed6-8fea-31d46ee035ed tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:00.624157 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a93bac88-857e-4c0d-a94d-f7b468b0cad0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:00.625088 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a93bac88-857e-4c0d-a94d-f7b468b0cad0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:00.631727 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a93bac88-857e-4c0d-a94d-f7b468b0cad0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:00.632165 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a93bac88-857e-4c0d-a94d-f7b468b0cad0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:00.632933 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a93bac88-857e-4c0d-a94d-f7b468b0cad0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:00.633363 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a93bac88-857e-4c0d-a94d-f7b468b0cad0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:04.043636 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0ff03862-d849-4ed6-8fea-31d46ee035ed tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 3.433193 Nov 08 16:14:04.044837 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 314/640] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:00 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 3435 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:14:04.049069 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8e4086c9-befe-4b1d-9364-ed91c27e1f62 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:04.049777 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8e4086c9-befe-4b1d-9364-ed91c27e1f62 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:04.051876 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a93bac88-857e-4c0d-a94d-f7b468b0cad0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 3.431325 Nov 08 16:14:04.053350 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 327/641] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:00 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 3433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:14:04.056630 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8e4086c9-befe-4b1d-9364-ed91c27e1f62 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:04.057072 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8e4086c9-befe-4b1d-9364-ed91c27e1f62 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:04.057370 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d0d1f0f4-ce14-448f-a77b-72f69dcc3e6f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:04.057876 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8e4086c9-befe-4b1d-9364-ed91c27e1f62 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:04.058135 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d0d1f0f4-ce14-448f-a77b-72f69dcc3e6f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:04.058426 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8e4086c9-befe-4b1d-9364-ed91c27e1f62 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:04.065071 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d0d1f0f4-ce14-448f-a77b-72f69dcc3e6f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:04.065514 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d0d1f0f4-ce14-448f-a77b-72f69dcc3e6f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:04.066377 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d0d1f0f4-ce14-448f-a77b-72f69dcc3e6f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:04.066802 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d0d1f0f4-ce14-448f-a77b-72f69dcc3e6f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:04.254095 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8e4086c9-befe-4b1d-9364-ed91c27e1f62 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:04.257152 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-d0d1f0f4-ce14-448f-a77b-72f69dcc3e6f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:04.261798 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8e4086c9-befe-4b1d-9364-ed91c27e1f62 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.216306 Nov 08 16:14:04.262366 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 315/642] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:04 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:04.265361 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d0d1f0f4-ce14-448f-a77b-72f69dcc3e6f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.211697 Nov 08 16:14:04.265941 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 328/643] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:04 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:05.055024 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3f59e1bd-ef96-4498-8fe8-d1e20eaa3325 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:05.055963 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3f59e1bd-ef96-4498-8fe8-d1e20eaa3325 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:05.062552 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3f59e1bd-ef96-4498-8fe8-d1e20eaa3325 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:05.063059 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3f59e1bd-ef96-4498-8fe8-d1e20eaa3325 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:05.063937 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3f59e1bd-ef96-4498-8fe8-d1e20eaa3325 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:05.064064 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c1f0e5ff-c54c-427d-a153-b2ffb3748412 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:05.064476 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3f59e1bd-ef96-4498-8fe8-d1e20eaa3325 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:05.064924 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c1f0e5ff-c54c-427d-a153-b2ffb3748412 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:05.071784 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c1f0e5ff-c54c-427d-a153-b2ffb3748412 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:05.072237 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c1f0e5ff-c54c-427d-a153-b2ffb3748412 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:05.073018 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c1f0e5ff-c54c-427d-a153-b2ffb3748412 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:05.073455 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c1f0e5ff-c54c-427d-a153-b2ffb3748412 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:05.365872 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c1f0e5ff-c54c-427d-a153-b2ffb3748412 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.305660 Nov 08 16:14:05.366514 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 329/644] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:05 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:14:05.371365 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-16e4dfc8-1769-4b8c-9de9-a4e3820feb31 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:05.372078 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-16e4dfc8-1769-4b8c-9de9-a4e3820feb31 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:05.378294 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3f59e1bd-ef96-4498-8fe8-d1e20eaa3325 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.326675 Nov 08 16:14:05.382333 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 316/645] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:05 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:14:05.382462 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-16e4dfc8-1769-4b8c-9de9-a4e3820feb31 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:05.382462 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-16e4dfc8-1769-4b8c-9de9-a4e3820feb31 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:05.382462 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-16e4dfc8-1769-4b8c-9de9-a4e3820feb31 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:05.382462 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-16e4dfc8-1769-4b8c-9de9-a4e3820feb31 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:05.384722 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0fdbc35d-cd3f-4ce8-a6cd-9d94230ff6b6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:05.385553 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0fdbc35d-cd3f-4ce8-a6cd-9d94230ff6b6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:05.392266 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0fdbc35d-cd3f-4ce8-a6cd-9d94230ff6b6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:05.392706 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0fdbc35d-cd3f-4ce8-a6cd-9d94230ff6b6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:05.393503 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0fdbc35d-cd3f-4ce8-a6cd-9d94230ff6b6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:05.393983 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0fdbc35d-cd3f-4ce8-a6cd-9d94230ff6b6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:05.578059 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-16e4dfc8-1769-4b8c-9de9-a4e3820feb31 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:05.584654 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0fdbc35d-cd3f-4ce8-a6cd-9d94230ff6b6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:05.585428 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-16e4dfc8-1769-4b8c-9de9-a4e3820feb31 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.217713 Nov 08 16:14:05.586230 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 330/646] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:05 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:05.601685 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0fdbc35d-cd3f-4ce8-a6cd-9d94230ff6b6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.221524 Nov 08 16:14:05.602281 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 317/647] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:05 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:06.376640 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-597e8dc1-8ae2-42cb-8594-b91b73277533 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:06.377472 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-597e8dc1-8ae2-42cb-8594-b91b73277533 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:06.383759 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-597e8dc1-8ae2-42cb-8594-b91b73277533 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:06.384207 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-597e8dc1-8ae2-42cb-8594-b91b73277533 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:06.385081 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-597e8dc1-8ae2-42cb-8594-b91b73277533 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:06.385515 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-597e8dc1-8ae2-42cb-8594-b91b73277533 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:06.389842 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ebc57936-56f3-4ddb-8d2b-24af9666ea16 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:06.390740 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ebc57936-56f3-4ddb-8d2b-24af9666ea16 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:06.396875 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ebc57936-56f3-4ddb-8d2b-24af9666ea16 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:06.397305 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ebc57936-56f3-4ddb-8d2b-24af9666ea16 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:06.398215 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ebc57936-56f3-4ddb-8d2b-24af9666ea16 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:06.398647 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ebc57936-56f3-4ddb-8d2b-24af9666ea16 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:10.707080 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-597e8dc1-8ae2-42cb-8594-b91b73277533 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 4.334198 Nov 08 16:14:10.707655 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 331/648] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:06 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 4336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:14:10.712675 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a3494ea3-53c5-4d68-8e40-d88b88b1c7f4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:10.713354 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a3494ea3-53c5-4d68-8e40-d88b88b1c7f4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:10.715285 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ebc57936-56f3-4ddb-8d2b-24af9666ea16 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 4.328971 Nov 08 16:14:10.715917 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 318/649] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:06 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 4331 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:14:10.720240 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a3494ea3-53c5-4d68-8e40-d88b88b1c7f4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:10.720682 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a3494ea3-53c5-4d68-8e40-d88b88b1c7f4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:10.720825 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-65aec423-91be-4723-9371-cb20a9aa2cd1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:10.721446 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a3494ea3-53c5-4d68-8e40-d88b88b1c7f4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:10.721552 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-65aec423-91be-4723-9371-cb20a9aa2cd1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:10.721905 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a3494ea3-53c5-4d68-8e40-d88b88b1c7f4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:10.728669 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-65aec423-91be-4723-9371-cb20a9aa2cd1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:10.729735 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-65aec423-91be-4723-9371-cb20a9aa2cd1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:10.730550 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-65aec423-91be-4723-9371-cb20a9aa2cd1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:10.730974 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-65aec423-91be-4723-9371-cb20a9aa2cd1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:10.916773 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a3494ea3-53c5-4d68-8e40-d88b88b1c7f4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:10.920355 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-65aec423-91be-4723-9371-cb20a9aa2cd1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:10.924143 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a3494ea3-53c5-4d68-8e40-d88b88b1c7f4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.215379 Nov 08 16:14:10.924708 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 332/650] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:10 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:10.928903 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-65aec423-91be-4723-9371-cb20a9aa2cd1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.211845 Nov 08 16:14:10.929455 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 319/651] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:10 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:11.718569 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9802345b-810c-4a7b-bceb-d09b6e24554a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:11.719481 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9802345b-810c-4a7b-bceb-d09b6e24554a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:11.725684 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9802345b-810c-4a7b-bceb-d09b6e24554a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:11.726156 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9802345b-810c-4a7b-bceb-d09b6e24554a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:11.726707 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3d8b7174-a851-4396-89d8-e1feb1e0d71f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:11.727128 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9802345b-810c-4a7b-bceb-d09b6e24554a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:11.727334 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9802345b-810c-4a7b-bceb-d09b6e24554a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:11.727621 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3d8b7174-a851-4396-89d8-e1feb1e0d71f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:11.733815 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3d8b7174-a851-4396-89d8-e1feb1e0d71f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:11.734257 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3d8b7174-a851-4396-89d8-e1feb1e0d71f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:11.735024 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3d8b7174-a851-4396-89d8-e1feb1e0d71f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:11.735451 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3d8b7174-a851-4396-89d8-e1feb1e0d71f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:11.940398 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9802345b-810c-4a7b-bceb-d09b6e24554a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.225367 Nov 08 16:14:11.944876 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 333/652] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:11 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:14:11.946683 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5d7d6d74-5cfb-475c-9d3f-9386d78dec30 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:11.947367 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5d7d6d74-5cfb-475c-9d3f-9386d78dec30 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:11.954059 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5d7d6d74-5cfb-475c-9d3f-9386d78dec30 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:11.954499 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5d7d6d74-5cfb-475c-9d3f-9386d78dec30 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:11.955258 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5d7d6d74-5cfb-475c-9d3f-9386d78dec30 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:11.955684 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5d7d6d74-5cfb-475c-9d3f-9386d78dec30 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:11.971683 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3d8b7174-a851-4396-89d8-e1feb1e0d71f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.248156 Nov 08 16:14:11.976085 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 320/653] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:11 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:14:11.978919 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ef1fe9dc-ac6a-4723-b78c-6b16e71a5451 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:11.979602 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ef1fe9dc-ac6a-4723-b78c-6b16e71a5451 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:11.986692 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ef1fe9dc-ac6a-4723-b78c-6b16e71a5451 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:11.987135 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ef1fe9dc-ac6a-4723-b78c-6b16e71a5451 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:11.987905 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ef1fe9dc-ac6a-4723-b78c-6b16e71a5451 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:11.988364 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ef1fe9dc-ac6a-4723-b78c-6b16e71a5451 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:12.140630 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-5d7d6d74-5cfb-475c-9d3f-9386d78dec30 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:12.147988 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5d7d6d74-5cfb-475c-9d3f-9386d78dec30 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.205656 Nov 08 16:14:12.148557 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 334/654] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:11 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:12.160867 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ef1fe9dc-ac6a-4723-b78c-6b16e71a5451 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:12.168810 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ef1fe9dc-ac6a-4723-b78c-6b16e71a5451 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.194362 Nov 08 16:14:12.169391 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 321/655] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:11 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:12.952193 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1866c5ce-5321-4449-98c7-293fb2f7891f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:12.953104 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1866c5ce-5321-4449-98c7-293fb2f7891f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:12.959569 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1866c5ce-5321-4449-98c7-293fb2f7891f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:12.960017 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1866c5ce-5321-4449-98c7-293fb2f7891f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:12.960787 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1866c5ce-5321-4449-98c7-293fb2f7891f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:12.961222 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1866c5ce-5321-4449-98c7-293fb2f7891f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:12.983432 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-683dab40-439c-4ef5-8784-e6aab293f3b1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:12.984434 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-683dab40-439c-4ef5-8784-e6aab293f3b1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:12.991359 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-683dab40-439c-4ef5-8784-e6aab293f3b1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:12.991790 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-683dab40-439c-4ef5-8784-e6aab293f3b1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:12.992544 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-683dab40-439c-4ef5-8784-e6aab293f3b1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:12.992965 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-683dab40-439c-4ef5-8784-e6aab293f3b1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:16.046471 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1866c5ce-5321-4449-98c7-293fb2f7891f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 3.097609 Nov 08 16:14:16.047129 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 335/656] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:12 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 3099 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:14:16.052711 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-04ab4647-b6a2-4413-a2e5-90b602adf21c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:16.053388 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-04ab4647-b6a2-4413-a2e5-90b602adf21c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:16.060150 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-04ab4647-b6a2-4413-a2e5-90b602adf21c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:16.060590 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-04ab4647-b6a2-4413-a2e5-90b602adf21c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:16.061360 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-04ab4647-b6a2-4413-a2e5-90b602adf21c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:16.061814 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-04ab4647-b6a2-4413-a2e5-90b602adf21c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:16.087520 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-683dab40-439c-4ef5-8784-e6aab293f3b1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 3.107582 Nov 08 16:14:16.091471 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 322/657] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:12 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 3109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:14:16.093171 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-bece6140-030c-44f8-9e41-4ea1fcda3edf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:16.094315 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-bece6140-030c-44f8-9e41-4ea1fcda3edf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:16.102503 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bece6140-030c-44f8-9e41-4ea1fcda3edf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:16.102946 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bece6140-030c-44f8-9e41-4ea1fcda3edf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:16.103768 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bece6140-030c-44f8-9e41-4ea1fcda3edf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:16.104197 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bece6140-030c-44f8-9e41-4ea1fcda3edf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:16.235016 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-04ab4647-b6a2-4413-a2e5-90b602adf21c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:16.243015 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-04ab4647-b6a2-4413-a2e5-90b602adf21c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.194748 Nov 08 16:14:16.243583 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 336/658] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:16 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:16.249247 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c1e77125-df43-4086-948f-0df0087be7de tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:16.249779 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c1e77125-df43-4086-948f-0df0087be7de tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:16.255625 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c1e77125-df43-4086-948f-0df0087be7de tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:16.256079 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c1e77125-df43-4086-948f-0df0087be7de tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:16.256862 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c1e77125-df43-4086-948f-0df0087be7de tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:16.257295 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c1e77125-df43-4086-948f-0df0087be7de tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:16.281098 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-bece6140-030c-44f8-9e41-4ea1fcda3edf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:16.289802 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-bece6140-030c-44f8-9e41-4ea1fcda3edf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.200254 Nov 08 16:14:16.290316 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 323/659] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:16 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:16.333851 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.objects.instance [None req-c1e77125-df43-4086-948f-0df0087be7de tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lazy-loading 'services' on Instance uuid cf462447-a55a-46b8-9afd-afca942aa011 {{(pid=115524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:14:16.402618 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c1e77125-df43-4086-948f-0df0087be7de tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "DELETE /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011/os-volume_attachments/059fb8b5-0319-4b35-9351-6d7fefe4270d" status: 202 len: 0 microversion: 2.1 time: 0.157836 Nov 08 16:14:16.403199 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 337/660] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Nov 8 16:14:16 2021] DELETE /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011/os-volume_attachments/059fb8b5-0319-4b35-9351-6d7fefe4270d => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:14:16.411802 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5dd65d68-39bd-4cdd-bbb3-ada0dd129840 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:16.412706 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5dd65d68-39bd-4cdd-bbb3-ada0dd129840 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:16.418955 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5dd65d68-39bd-4cdd-bbb3-ada0dd129840 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:16.419393 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5dd65d68-39bd-4cdd-bbb3-ada0dd129840 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:16.420152 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5dd65d68-39bd-4cdd-bbb3-ada0dd129840 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:16.420583 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5dd65d68-39bd-4cdd-bbb3-ada0dd129840 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:16.449532 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5dd65d68-39bd-4cdd-bbb3-ada0dd129840 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041980 Nov 08 16:14:16.450110 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 324/661] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:14:16 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:14:17.059694 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4d81eaed-55e2-4d63-a709-9353cca0ed31 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:17.060739 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4d81eaed-55e2-4d63-a709-9353cca0ed31 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:17.067167 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4d81eaed-55e2-4d63-a709-9353cca0ed31 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:17.067615 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4d81eaed-55e2-4d63-a709-9353cca0ed31 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:17.068380 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4d81eaed-55e2-4d63-a709-9353cca0ed31 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:17.068828 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4d81eaed-55e2-4d63-a709-9353cca0ed31 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:17.099818 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ab763cb8-b353-453d-9b5f-871d7cbf9c78 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:17.100710 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ab763cb8-b353-453d-9b5f-871d7cbf9c78 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:17.106835 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ab763cb8-b353-453d-9b5f-871d7cbf9c78 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:17.107269 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ab763cb8-b353-453d-9b5f-871d7cbf9c78 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:17.108032 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ab763cb8-b353-453d-9b5f-871d7cbf9c78 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:17.108454 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ab763cb8-b353-453d-9b5f-871d7cbf9c78 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:17.920369 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ab763cb8-b353-453d-9b5f-871d7cbf9c78 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.824569 Nov 08 16:14:17.921918 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 325/662] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:17 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:14:17.925153 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4d81eaed-55e2-4d63-a709-9353cca0ed31 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.869882 Nov 08 16:14:17.925807 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 338/663] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:17 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:14:17.929643 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1bc97322-02c1-4e34-8c59-36e98624abd9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:17.929820 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1bc97322-02c1-4e34-8c59-36e98624abd9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:17.931233 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b7b0a708-9d2a-4b3b-90d6-29f82c2ac0ca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:17.931929 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b7b0a708-9d2a-4b3b-90d6-29f82c2ac0ca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:17.937012 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1bc97322-02c1-4e34-8c59-36e98624abd9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:17.937464 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1bc97322-02c1-4e34-8c59-36e98624abd9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:17.938281 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1bc97322-02c1-4e34-8c59-36e98624abd9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:17.938517 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b7b0a708-9d2a-4b3b-90d6-29f82c2ac0ca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:17.938707 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1bc97322-02c1-4e34-8c59-36e98624abd9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:17.938975 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b7b0a708-9d2a-4b3b-90d6-29f82c2ac0ca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:17.939759 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b7b0a708-9d2a-4b3b-90d6-29f82c2ac0ca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:17.940198 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b7b0a708-9d2a-4b3b-90d6-29f82c2ac0ca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:18.137634 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b7b0a708-9d2a-4b3b-90d6-29f82c2ac0ca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:18.144824 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1bc97322-02c1-4e34-8c59-36e98624abd9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:18.149494 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b7b0a708-9d2a-4b3b-90d6-29f82c2ac0ca tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.221987 Nov 08 16:14:18.150350 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 339/664] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:17 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:18.155242 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d2eaeb33-1922-41b7-801a-774a9c64cf02 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:18.156399 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d2eaeb33-1922-41b7-801a-774a9c64cf02 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:18.162095 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1bc97322-02c1-4e34-8c59-36e98624abd9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.238205 Nov 08 16:14:18.164281 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 326/665] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:17 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:18.164941 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d2eaeb33-1922-41b7-801a-774a9c64cf02 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:18.165397 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d2eaeb33-1922-41b7-801a-774a9c64cf02 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:18.166226 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d2eaeb33-1922-41b7-801a-774a9c64cf02 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:18.166664 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d2eaeb33-1922-41b7-801a-774a9c64cf02 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:18.198888 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d2eaeb33-1922-41b7-801a-774a9c64cf02 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047304 Nov 08 16:14:18.199451 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 340/666] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:14:18 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:14:18.931667 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e3ff0427-53a0-4cc1-97fc-8e6638ae818c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:18.932609 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e3ff0427-53a0-4cc1-97fc-8e6638ae818c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:18.937099 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2acf6273-e343-4143-946e-9cf2a2a6d31a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:18.938111 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2acf6273-e343-4143-946e-9cf2a2a6d31a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:18.941514 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e3ff0427-53a0-4cc1-97fc-8e6638ae818c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:18.941985 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e3ff0427-53a0-4cc1-97fc-8e6638ae818c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:18.942777 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e3ff0427-53a0-4cc1-97fc-8e6638ae818c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:18.943201 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e3ff0427-53a0-4cc1-97fc-8e6638ae818c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:18.944206 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2acf6273-e343-4143-946e-9cf2a2a6d31a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:18.944647 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2acf6273-e343-4143-946e-9cf2a2a6d31a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:18.945414 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2acf6273-e343-4143-946e-9cf2a2a6d31a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:18.945945 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2acf6273-e343-4143-946e-9cf2a2a6d31a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:19.416863 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e3ff0427-53a0-4cc1-97fc-8e6638ae818c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.488650 Nov 08 16:14:19.417552 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 327/667] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:18 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:14:19.422326 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-537d38ba-b1a8-43d9-b387-abe98e64d9ed tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:19.423005 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-537d38ba-b1a8-43d9-b387-abe98e64d9ed tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:19.430145 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-537d38ba-b1a8-43d9-b387-abe98e64d9ed tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:19.430681 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-537d38ba-b1a8-43d9-b387-abe98e64d9ed tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:19.431452 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-537d38ba-b1a8-43d9-b387-abe98e64d9ed tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:19.431884 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-537d38ba-b1a8-43d9-b387-abe98e64d9ed tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:19.434919 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2acf6273-e343-4143-946e-9cf2a2a6d31a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.501283 Nov 08 16:14:19.435758 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 341/668] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:18 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:14:19.440622 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-440313d6-b2f8-4eeb-ae69-25c6495f0460 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:19.441260 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-440313d6-b2f8-4eeb-ae69-25c6495f0460 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:19.448812 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-440313d6-b2f8-4eeb-ae69-25c6495f0460 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:19.449258 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-440313d6-b2f8-4eeb-ae69-25c6495f0460 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:19.450048 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-440313d6-b2f8-4eeb-ae69-25c6495f0460 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:19.450474 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-440313d6-b2f8-4eeb-ae69-25c6495f0460 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:19.628484 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-537d38ba-b1a8-43d9-b387-abe98e64d9ed tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:19.632841 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-440313d6-b2f8-4eeb-ae69-25c6495f0460 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:19.637499 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-537d38ba-b1a8-43d9-b387-abe98e64d9ed tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.218750 Nov 08 16:14:19.638316 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 328/669] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:19 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:19.643131 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-440313d6-b2f8-4eeb-ae69-25c6495f0460 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.206294 Nov 08 16:14:19.643821 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 342/670] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:19 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:19.649731 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-56124929-c28c-44ea-a840-ef346e575567 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:19.650840 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-56124929-c28c-44ea-a840-ef346e575567 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:19.657606 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-56124929-c28c-44ea-a840-ef346e575567 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:19.658098 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-56124929-c28c-44ea-a840-ef346e575567 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:19.658880 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-56124929-c28c-44ea-a840-ef346e575567 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:19.659320 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-56124929-c28c-44ea-a840-ef346e575567 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:19.689255 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-56124929-c28c-44ea-a840-ef346e575567 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043230 Nov 08 16:14:19.690022 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 329/671] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:14:19 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:14:20.428294 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e939487d-65de-4bbb-9587-6d1077cf5b12 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:20.429259 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e939487d-65de-4bbb-9587-6d1077cf5b12 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:20.435533 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e939487d-65de-4bbb-9587-6d1077cf5b12 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:20.436098 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e939487d-65de-4bbb-9587-6d1077cf5b12 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:20.436854 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e939487d-65de-4bbb-9587-6d1077cf5b12 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:20.437283 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e939487d-65de-4bbb-9587-6d1077cf5b12 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:20.446317 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6c85a3ef-cec9-4cf9-a7ff-961a3e238a22 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:20.447310 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6c85a3ef-cec9-4cf9-a7ff-961a3e238a22 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:20.453480 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6c85a3ef-cec9-4cf9-a7ff-961a3e238a22 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:20.453951 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6c85a3ef-cec9-4cf9-a7ff-961a3e238a22 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:20.454764 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6c85a3ef-cec9-4cf9-a7ff-961a3e238a22 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:20.455193 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6c85a3ef-cec9-4cf9-a7ff-961a3e238a22 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:20.601161 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e939487d-65de-4bbb-9587-6d1077cf5b12 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.176360 Nov 08 16:14:20.601942 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 343/672] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:20 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:14:20.641534 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6c85a3ef-cec9-4cf9-a7ff-961a3e238a22 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.198686 Nov 08 16:14:20.646271 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 330/673] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:20 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:14:20.655106 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-beee598c-0ee1-4388-871e-053623892456 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:20.655907 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-beee598c-0ee1-4388-871e-053623892456 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:20.661217 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-bfb589fc-4787-405b-92cf-7cb8e1008b48 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:20.662029 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-bfb589fc-4787-405b-92cf-7cb8e1008b48 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:20.663108 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-beee598c-0ee1-4388-871e-053623892456 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:20.663578 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-beee598c-0ee1-4388-871e-053623892456 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:20.664626 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-beee598c-0ee1-4388-871e-053623892456 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:20.665058 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-beee598c-0ee1-4388-871e-053623892456 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:20.669430 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bfb589fc-4787-405b-92cf-7cb8e1008b48 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:20.670124 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bfb589fc-4787-405b-92cf-7cb8e1008b48 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:20.670978 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bfb589fc-4787-405b-92cf-7cb8e1008b48 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:20.671556 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bfb589fc-4787-405b-92cf-7cb8e1008b48 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:20.860978 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-bfb589fc-4787-405b-92cf-7cb8e1008b48 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:20.867577 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-beee598c-0ee1-4388-871e-053623892456 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:20.870173 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-bfb589fc-4787-405b-92cf-7cb8e1008b48 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1314 microversion: 2.1 time: 0.213192 Nov 08 16:14:20.870745 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 331/674] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:20 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:20.875339 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0faffe8b-d1ca-4787-87ce-6d659b18ff2b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:20.875667 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-beee598c-0ee1-4388-871e-053623892456 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.224766 Nov 08 16:14:20.876431 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0faffe8b-d1ca-4787-87ce-6d659b18ff2b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:20.877093 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 344/675] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:20 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:20.886214 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0faffe8b-d1ca-4787-87ce-6d659b18ff2b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:20.886609 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0faffe8b-d1ca-4787-87ce-6d659b18ff2b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:20.887520 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0faffe8b-d1ca-4787-87ce-6d659b18ff2b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:20.887944 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0faffe8b-d1ca-4787-87ce-6d659b18ff2b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:20.916213 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0faffe8b-d1ca-4787-87ce-6d659b18ff2b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044508 Nov 08 16:14:20.916764 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 332/676] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:14:20 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:14:21.318137 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-912e7eb3-7eb4-485d-b6e2-1a8677cf8a39 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1d1e0de-bbe7-4f45-9804-6f4726fbdadc", "device": "/dev/sdb"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:21.319700 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-912e7eb3-7eb4-485d-b6e2-1a8677cf8a39 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:21.326065 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-912e7eb3-7eb4-485d-b6e2-1a8677cf8a39 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:21.326517 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-912e7eb3-7eb4-485d-b6e2-1a8677cf8a39 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:21.327475 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-912e7eb3-7eb4-485d-b6e2-1a8677cf8a39 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:21.327916 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-912e7eb3-7eb4-485d-b6e2-1a8677cf8a39 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:21.578502 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-912e7eb3-7eb4-485d-b6e2-1a8677cf8a39 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "POST /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264013 Nov 08 16:14:21.579609 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 345/677] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Nov 8 16:14:21 2021] POST /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:14:21.612490 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-099b8323-9b71-43da-860b-8381ae52c490 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:21.613383 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-099b8323-9b71-43da-860b-8381ae52c490 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:21.620856 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-099b8323-9b71-43da-860b-8381ae52c490 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:21.621152 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-099b8323-9b71-43da-860b-8381ae52c490 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:21.621931 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-099b8323-9b71-43da-860b-8381ae52c490 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:21.623108 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-099b8323-9b71-43da-860b-8381ae52c490 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:21.654294 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-39626405-cbbe-494c-a5a4-425f19159e76 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:21.655347 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-39626405-cbbe-494c-a5a4-425f19159e76 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:21.662071 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-39626405-cbbe-494c-a5a4-425f19159e76 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:21.662523 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-39626405-cbbe-494c-a5a4-425f19159e76 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:21.663303 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-39626405-cbbe-494c-a5a4-425f19159e76 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:21.663737 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-39626405-cbbe-494c-a5a4-425f19159e76 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:21.795172 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-099b8323-9b71-43da-860b-8381ae52c490 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.186111 Nov 08 16:14:21.799272 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 333/678] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:21 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:14:21.855610 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-39626405-cbbe-494c-a5a4-425f19159e76 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.205632 Nov 08 16:14:21.856561 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 346/679] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:21 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:14:21.888223 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ca852f3a-6046-43e0-8418-0f27034879e9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:21.888919 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ca852f3a-6046-43e0-8418-0f27034879e9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:21.893785 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f89cbaa8-6f48-4d84-8cba-e9308e263b0a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:21.894494 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f89cbaa8-6f48-4d84-8cba-e9308e263b0a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:21.896297 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ca852f3a-6046-43e0-8418-0f27034879e9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:21.896739 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ca852f3a-6046-43e0-8418-0f27034879e9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:21.897510 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ca852f3a-6046-43e0-8418-0f27034879e9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:21.897963 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ca852f3a-6046-43e0-8418-0f27034879e9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:21.901040 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f89cbaa8-6f48-4d84-8cba-e9308e263b0a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:21.901482 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f89cbaa8-6f48-4d84-8cba-e9308e263b0a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:21.902270 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f89cbaa8-6f48-4d84-8cba-e9308e263b0a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:21.902697 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f89cbaa8-6f48-4d84-8cba-e9308e263b0a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:22.095653 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ca852f3a-6046-43e0-8418-0f27034879e9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:22.099527 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f89cbaa8-6f48-4d84-8cba-e9308e263b0a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:22.102928 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ca852f3a-6046-43e0-8418-0f27034879e9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1499 microversion: 2.1 time: 0.218714 Nov 08 16:14:22.103488 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 334/680] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:21 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1499 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:22.107470 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f89cbaa8-6f48-4d84-8cba-e9308e263b0a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.217616 Nov 08 16:14:22.116880 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 347/681] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:21 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:14:22.118865 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-880817ef-2bea-4d20-a916-cd95e3e5eb00 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:22.119232 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-880817ef-2bea-4d20-a916-cd95e3e5eb00 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:22.125274 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-880817ef-2bea-4d20-a916-cd95e3e5eb00 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:22.125731 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-880817ef-2bea-4d20-a916-cd95e3e5eb00 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:22.126496 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-880817ef-2bea-4d20-a916-cd95e3e5eb00 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:22.126919 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-880817ef-2bea-4d20-a916-cd95e3e5eb00 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:22.153595 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-880817ef-2bea-4d20-a916-cd95e3e5eb00 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Going to try to terminate instance {{(pid=115523) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:14:22.227996 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-880817ef-2bea-4d20-a916-cd95e3e5eb00 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "DELETE /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 204 len: 0 microversion: 2.1 time: 0.112479 Nov 08 16:14:22.228827 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 335/682] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:14:22 2021] DELETE /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:14:22.239585 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e9bc93a0-967c-4896-8f26-aa985e902018 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:22.240250 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e9bc93a0-967c-4896-8f26-aa985e902018 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:22.247643 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e9bc93a0-967c-4896-8f26-aa985e902018 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:22.248210 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e9bc93a0-967c-4896-8f26-aa985e902018 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:22.248976 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e9bc93a0-967c-4896-8f26-aa985e902018 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:22.249401 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e9bc93a0-967c-4896-8f26-aa985e902018 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:22.384371 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e9bc93a0-967c-4896-8f26-aa985e902018 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:22.391974 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e9bc93a0-967c-4896-8f26-aa985e902018 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1514 microversion: 2.1 time: 0.158712 Nov 08 16:14:22.393144 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 348/683] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:22 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:22.807374 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-25512a30-a878-45ff-b10a-38a4d893e34f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:22.808363 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-25512a30-a878-45ff-b10a-38a4d893e34f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:22.814521 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25512a30-a878-45ff-b10a-38a4d893e34f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:22.814959 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25512a30-a878-45ff-b10a-38a4d893e34f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:22.815721 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25512a30-a878-45ff-b10a-38a4d893e34f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:22.816148 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25512a30-a878-45ff-b10a-38a4d893e34f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:22.867356 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0ec2ead8-c55f-4939-ba40-a59ce755c1fe tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:22.868352 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0ec2ead8-c55f-4939-ba40-a59ce755c1fe tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:22.874915 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0ec2ead8-c55f-4939-ba40-a59ce755c1fe tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:22.875384 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0ec2ead8-c55f-4939-ba40-a59ce755c1fe tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:22.876157 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0ec2ead8-c55f-4939-ba40-a59ce755c1fe tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:22.876612 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0ec2ead8-c55f-4939-ba40-a59ce755c1fe tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:22.907424 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-25512a30-a878-45ff-b10a-38a4d893e34f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.103806 Nov 08 16:14:22.909759 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 336/684] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:22 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:14:22.942983 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0ec2ead8-c55f-4939-ba40-a59ce755c1fe tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.079137 Nov 08 16:14:22.943838 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 349/685] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:22 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:14:23.067314 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-49598ed6-a24c-40b7-b5d5-f8075debed97 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:23.067897 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-49598ed6-a24c-40b7-b5d5-f8075debed97 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:23.074751 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-49598ed6-a24c-40b7-b5d5-f8075debed97 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:23.075198 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-49598ed6-a24c-40b7-b5d5-f8075debed97 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:23.075967 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-49598ed6-a24c-40b7-b5d5-f8075debed97 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:23.076400 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-49598ed6-a24c-40b7-b5d5-f8075debed97 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:23.102175 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-49598ed6-a24c-40b7-b5d5-f8075debed97 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Going to try to terminate instance {{(pid=115523) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:14:23.124914 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-90b5350e-7f74-48f4-b1ab-2799e6d927c5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:23.125612 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-90b5350e-7f74-48f4-b1ab-2799e6d927c5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:23.132924 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-90b5350e-7f74-48f4-b1ab-2799e6d927c5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:23.133378 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-90b5350e-7f74-48f4-b1ab-2799e6d927c5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:23.134200 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-90b5350e-7f74-48f4-b1ab-2799e6d927c5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:23.134643 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-90b5350e-7f74-48f4-b1ab-2799e6d927c5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:23.176884 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-49598ed6-a24c-40b7-b5d5-f8075debed97 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "DELETE /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 204 len: 0 microversion: 2.1 time: 0.113164 Nov 08 16:14:23.177918 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 337/686] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:14:23 2021] DELETE /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:14:23.186359 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0c465d2b-9034-413b-a75c-a6f12c8522f9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:23.187046 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0c465d2b-9034-413b-a75c-a6f12c8522f9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:23.193519 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0c465d2b-9034-413b-a75c-a6f12c8522f9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:23.194000 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0c465d2b-9034-413b-a75c-a6f12c8522f9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:23.194753 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0c465d2b-9034-413b-a75c-a6f12c8522f9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:23.195174 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0c465d2b-9034-413b-a75c-a6f12c8522f9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:23.302132 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-90b5350e-7f74-48f4-b1ab-2799e6d927c5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:23.309855 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-90b5350e-7f74-48f4-b1ab-2799e6d927c5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.189219 Nov 08 16:14:23.310417 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 350/687] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:23 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:14:23.360498 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0c465d2b-9034-413b-a75c-a6f12c8522f9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:23.367725 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0c465d2b-9034-413b-a75c-a6f12c8522f9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1505 microversion: 2.1 time: 0.185291 Nov 08 16:14:23.368291 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 338/688] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:23 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1505 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:23.408842 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a983d6fa-319d-4834-b38c-83e765c3aa74 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:23.409449 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a983d6fa-319d-4834-b38c-83e765c3aa74 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:23.416322 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a983d6fa-319d-4834-b38c-83e765c3aa74 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:23.416767 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a983d6fa-319d-4834-b38c-83e765c3aa74 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:23.417527 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a983d6fa-319d-4834-b38c-83e765c3aa74 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:23.417982 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a983d6fa-319d-4834-b38c-83e765c3aa74 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:23.545743 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a983d6fa-319d-4834-b38c-83e765c3aa74 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:23.552933 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a983d6fa-319d-4834-b38c-83e765c3aa74 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1514 microversion: 2.1 time: 0.147735 Nov 08 16:14:23.553495 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 351/689] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:23 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:23.918898 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f9f8841c-e9fa-43b1-abe5-342b588a4201 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:23.919806 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f9f8841c-e9fa-43b1-abe5-342b588a4201 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:23.926014 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f9f8841c-e9fa-43b1-abe5-342b588a4201 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:23.926460 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f9f8841c-e9fa-43b1-abe5-342b588a4201 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:23.927226 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f9f8841c-e9fa-43b1-abe5-342b588a4201 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:23.927659 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f9f8841c-e9fa-43b1-abe5-342b588a4201 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:23.954995 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-85a0613f-d972-48ff-a81e-ee3c99e4661c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:23.956231 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-85a0613f-d972-48ff-a81e-ee3c99e4661c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:23.963267 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-85a0613f-d972-48ff-a81e-ee3c99e4661c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:23.963716 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-85a0613f-d972-48ff-a81e-ee3c99e4661c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:23.964495 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-85a0613f-d972-48ff-a81e-ee3c99e4661c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:23.964931 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-85a0613f-d972-48ff-a81e-ee3c99e4661c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:24.003454 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f9f8841c-e9fa-43b1-abe5-342b588a4201 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.088124 Nov 08 16:14:24.004125 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 339/690] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:23 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:14:24.040423 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-85a0613f-d972-48ff-a81e-ee3c99e4661c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.089764 Nov 08 16:14:24.041043 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 352/691] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:23 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:14:24.327073 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-84ce5f19-bbc1-430d-8a22-c674708342db tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:24.327794 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-84ce5f19-bbc1-430d-8a22-c674708342db tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:24.335213 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84ce5f19-bbc1-430d-8a22-c674708342db tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:24.335660 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84ce5f19-bbc1-430d-8a22-c674708342db tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:24.336428 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84ce5f19-bbc1-430d-8a22-c674708342db tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:24.336858 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84ce5f19-bbc1-430d-8a22-c674708342db tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:24.385551 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-8d653772-01d1-45b9-a712-5884847cde67 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:24.392202 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-8d653772-01d1-45b9-a712-5884847cde67 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:24.400353 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8d653772-01d1-45b9-a712-5884847cde67 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:24.400828 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8d653772-01d1-45b9-a712-5884847cde67 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:24.401623 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8d653772-01d1-45b9-a712-5884847cde67 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:24.402088 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8d653772-01d1-45b9-a712-5884847cde67 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:24.502722 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-84ce5f19-bbc1-430d-8a22-c674708342db tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:24.510986 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-84ce5f19-bbc1-430d-8a22-c674708342db tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.187865 Nov 08 16:14:24.511551 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 340/692] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:24 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:24.561450 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-8d653772-01d1-45b9-a712-5884847cde67 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:24.569557 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-8d653772-01d1-45b9-a712-5884847cde67 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1505 microversion: 2.1 time: 0.188075 Nov 08 16:14:24.569823 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-15c7d987-e88e-4076-bc18-9c9353f2a62e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:24.570142 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 353/693] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:24 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:14:24.574938 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-15c7d987-e88e-4076-bc18-9c9353f2a62e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:24.576371 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-15c7d987-e88e-4076-bc18-9c9353f2a62e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:24.576810 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-15c7d987-e88e-4076-bc18-9c9353f2a62e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:24.577578 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-15c7d987-e88e-4076-bc18-9c9353f2a62e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:24.578035 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-15c7d987-e88e-4076-bc18-9c9353f2a62e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:24.709026 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-15c7d987-e88e-4076-bc18-9c9353f2a62e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:24.716446 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-15c7d987-e88e-4076-bc18-9c9353f2a62e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1514 microversion: 2.1 time: 0.150770 Nov 08 16:14:24.717120 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 341/694] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:24 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:14:25.015172 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-6fedec21-62e1-46f9-bf3f-190607eceb77 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:25.016103 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-6fedec21-62e1-46f9-bf3f-190607eceb77 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:25.022794 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6fedec21-62e1-46f9-bf3f-190607eceb77 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:25.023242 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6fedec21-62e1-46f9-bf3f-190607eceb77 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:25.024130 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6fedec21-62e1-46f9-bf3f-190607eceb77 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:25.024578 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6fedec21-62e1-46f9-bf3f-190607eceb77 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:25.051705 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-868a2c0e-791c-4412-879f-7c2186674be9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:25.053701 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-868a2c0e-791c-4412-879f-7c2186674be9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:25.059853 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-868a2c0e-791c-4412-879f-7c2186674be9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:25.060360 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-868a2c0e-791c-4412-879f-7c2186674be9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:25.061217 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-868a2c0e-791c-4412-879f-7c2186674be9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:25.061636 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-868a2c0e-791c-4412-879f-7c2186674be9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:25.104161 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-6fedec21-62e1-46f9-bf3f-190607eceb77 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.092669 Nov 08 16:14:25.110812 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 354/695] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:25 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:14:25.156242 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-868a2c0e-791c-4412-879f-7c2186674be9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.108646 Nov 08 16:14:25.157766 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 342/696] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:25 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:14:25.528875 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e5ed1d2d-129e-4eaf-a56c-e5d005838723 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:25.529813 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e5ed1d2d-129e-4eaf-a56c-e5d005838723 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:25.538110 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e5ed1d2d-129e-4eaf-a56c-e5d005838723 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:25.538565 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e5ed1d2d-129e-4eaf-a56c-e5d005838723 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:25.539825 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e5ed1d2d-129e-4eaf-a56c-e5d005838723 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:25.540663 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e5ed1d2d-129e-4eaf-a56c-e5d005838723 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:25.592327 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-07b74b2f-9b93-4951-a279-764fb72a7dfb tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:25.593332 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-07b74b2f-9b93-4951-a279-764fb72a7dfb tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:25.601086 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-07b74b2f-9b93-4951-a279-764fb72a7dfb tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:25.601805 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-07b74b2f-9b93-4951-a279-764fb72a7dfb tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:25.602749 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-07b74b2f-9b93-4951-a279-764fb72a7dfb tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:25.603327 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-07b74b2f-9b93-4951-a279-764fb72a7dfb tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:25.742236 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e5ed1d2d-129e-4eaf-a56c-e5d005838723 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:25.752597 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e5ed1d2d-129e-4eaf-a56c-e5d005838723 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.227888 Nov 08 16:14:25.763126 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 355/697] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:25 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:25.768159 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b0fb7975-edcb-47d0-8828-e3151a709661 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:25.768949 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b0fb7975-edcb-47d0-8828-e3151a709661 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:25.775210 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b0fb7975-edcb-47d0-8828-e3151a709661 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:25.775661 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b0fb7975-edcb-47d0-8828-e3151a709661 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:25.776439 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b0fb7975-edcb-47d0-8828-e3151a709661 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:25.777056 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b0fb7975-edcb-47d0-8828-e3151a709661 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:25.861010 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-07b74b2f-9b93-4951-a279-764fb72a7dfb tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:25.868708 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-07b74b2f-9b93-4951-a279-764fb72a7dfb tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1505 microversion: 2.1 time: 0.283784 Nov 08 16:14:25.869592 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 343/698] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:25 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1505 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:26.042171 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b0fb7975-edcb-47d0-8828-e3151a709661 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:26.042746 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-32b57833-d0fb-4ee9-ac60-b28d09d8cfc8 req-d8f5d70f-324e-4e6f-bd90-025c2c323fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf462447-a55a-46b8-9afd-afca942aa011", "name": "network-vif-deleted", "tag": "f47160fc-9457-4c27-a7dc-b4b4b112f9b1"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:26.044878 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:14:26.044878 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:14:26.059069 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-32b57833-d0fb-4ee9-ac60-b28d09d8cfc8 req-d8f5d70f-324e-4e6f-bd90-025c2c323fde service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:26.059793 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-32b57833-d0fb-4ee9-ac60-b28d09d8cfc8 req-d8f5d70f-324e-4e6f-bd90-025c2c323fde service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:26.066308 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b0fb7975-edcb-47d0-8828-e3151a709661 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 200 len: 1514 microversion: 2.1 time: 0.301754 Nov 08 16:14:26.067840 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 356/699] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:25 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 1514 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:26.077043 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-32b57833-d0fb-4ee9-ac60-b28d09d8cfc8 req-d8f5d70f-324e-4e6f-bd90-025c2c323fde service nova] Creating event network-vif-deleted:f47160fc-9457-4c27-a7dc-b4b4b112f9b1 for instance cf462447-a55a-46b8-9afd-afca942aa011 on hv-cinder-81618 Nov 08 16:14:26.081497 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-32b57833-d0fb-4ee9-ac60-b28d09d8cfc8 req-d8f5d70f-324e-4e6f-bd90-025c2c323fde service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042667 Nov 08 16:14:26.083480 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 344/700] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:14:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:14:26.116786 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-96aa4218-68d8-46f4-9bca-0960ebd4660e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:26.117916 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-96aa4218-68d8-46f4-9bca-0960ebd4660e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:26.124541 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-96aa4218-68d8-46f4-9bca-0960ebd4660e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:26.125256 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-96aa4218-68d8-46f4-9bca-0960ebd4660e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:26.126305 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-96aa4218-68d8-46f4-9bca-0960ebd4660e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:26.126932 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-96aa4218-68d8-46f4-9bca-0960ebd4660e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:26.167850 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-8a59d7b0-9e01-47de-b447-df3098c14f24 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:26.169208 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-8a59d7b0-9e01-47de-b447-df3098c14f24 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:26.176386 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8a59d7b0-9e01-47de-b447-df3098c14f24 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:26.178094 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8a59d7b0-9e01-47de-b447-df3098c14f24 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:26.179505 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8a59d7b0-9e01-47de-b447-df3098c14f24 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:26.182507 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8a59d7b0-9e01-47de-b447-df3098c14f24 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:26.209192 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-96aa4218-68d8-46f4-9bca-0960ebd4660e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.096409 Nov 08 16:14:26.213025 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 345/701] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:26 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:14:26.274354 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-8a59d7b0-9e01-47de-b447-df3098c14f24 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.109898 Nov 08 16:14:26.275739 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 357/702] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:26 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:14:26.474787 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-dc72ee62-d96a-4d75-a0fe-2a0b80468e12 req-828455df-bbb6-4dcd-866c-17115fdc88e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e5636f-2ecf-4438-8be2-e973029678a1", "name": "network-vif-deleted", "tag": "2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:26.476392 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:14:26.476392 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:14:26.484655 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-dc72ee62-d96a-4d75-a0fe-2a0b80468e12 req-828455df-bbb6-4dcd-866c-17115fdc88e9 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:26.485358 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-dc72ee62-d96a-4d75-a0fe-2a0b80468e12 req-828455df-bbb6-4dcd-866c-17115fdc88e9 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:26.511281 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-dc72ee62-d96a-4d75-a0fe-2a0b80468e12 req-828455df-bbb6-4dcd-866c-17115fdc88e9 service nova] Creating event network-vif-deleted:2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e for instance 37e5636f-2ecf-4438-8be2-e973029678a1 on hv-cinder-81618 Nov 08 16:14:26.516000 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-dc72ee62-d96a-4d75-a0fe-2a0b80468e12 req-828455df-bbb6-4dcd-866c-17115fdc88e9 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045216 Nov 08 16:14:26.516597 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 346/703] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:14:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:14:26.771309 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ad3c912f-b97c-4185-b6fd-65edb63ac2bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:26.772001 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ad3c912f-b97c-4185-b6fd-65edb63ac2bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:26.778870 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad3c912f-b97c-4185-b6fd-65edb63ac2bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:26.779322 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad3c912f-b97c-4185-b6fd-65edb63ac2bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:26.780091 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad3c912f-b97c-4185-b6fd-65edb63ac2bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:26.780556 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad3c912f-b97c-4185-b6fd-65edb63ac2bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:26.887141 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-10b71dea-7dec-458a-be47-ebd6bde874a3 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:26.887911 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-10b71dea-7dec-458a-be47-ebd6bde874a3 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:26.893897 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-10b71dea-7dec-458a-be47-ebd6bde874a3 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:26.894345 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-10b71dea-7dec-458a-be47-ebd6bde874a3 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:26.895783 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-10b71dea-7dec-458a-be47-ebd6bde874a3 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:26.896248 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-10b71dea-7dec-458a-be47-ebd6bde874a3 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:26.912275 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-ad3c912f-b97c-4185-b6fd-65edb63ac2bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:26.920576 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ad3c912f-b97c-4185-b6fd-65edb63ac2bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.154025 Nov 08 16:14:26.921143 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 358/704] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:26 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:26.927618 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-10b71dea-7dec-458a-be47-ebd6bde874a3 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:26.928133 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-10b71dea-7dec-458a-be47-ebd6bde874a3 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:26.928573 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.objects.instance [None req-10b71dea-7dec-458a-be47-ebd6bde874a3 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lazy-loading 'fault' on Instance uuid 37e5636f-2ecf-4438-8be2-e973029678a1 {{(pid=115523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:14:26.967149 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-10b71dea-7dec-458a-be47-ebd6bde874a3 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e2605b08484b20b429bb32fab97a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:26.974361 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-10b71dea-7dec-458a-be47-ebd6bde874a3 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 200 len: 1304 microversion: 2.1 time: 0.091926 Nov 08 16:14:26.974919 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 347/705] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:26 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:14:27.084412 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a5a91b45-3cf8-47f2-aca8-41950ad8c16d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:27.084962 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a5a91b45-3cf8-47f2-aca8-41950ad8c16d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: cf462447-a55a-46b8-9afd-afca942aa011] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:27.091591 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a5a91b45-3cf8-47f2-aca8-41950ad8c16d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:27.092041 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a5a91b45-3cf8-47f2-aca8-41950ad8c16d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:27.092806 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a5a91b45-3cf8-47f2-aca8-41950ad8c16d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:27.093236 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a5a91b45-3cf8-47f2-aca8-41950ad8c16d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:27.106951 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-a5a91b45-3cf8-47f2-aca8-41950ad8c16d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] HTTP exception thrown: Instance cf462447-a55a-46b8-9afd-afca942aa011 could not be found. Nov 08 16:14:27.107544 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a5a91b45-3cf8-47f2-aca8-41950ad8c16d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Returning 404 to user: Instance cf462447-a55a-46b8-9afd-afca942aa011 could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:14:27.108430 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a5a91b45-3cf8-47f2-aca8-41950ad8c16d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011" status: 404 len: 111 microversion: 2.1 time: 0.028105 Nov 08 16:14:27.108912 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 359/706] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:27 2021] GET /compute/v2.1/servers/cf462447-a55a-46b8-9afd-afca942aa011 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:14:27.220818 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b7d29ae1-fbf0-4a1d-8a7a-75e583eefc39 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:27.221841 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b7d29ae1-fbf0-4a1d-8a7a-75e583eefc39 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:27.228080 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b7d29ae1-fbf0-4a1d-8a7a-75e583eefc39 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:27.228522 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b7d29ae1-fbf0-4a1d-8a7a-75e583eefc39 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:27.229272 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b7d29ae1-fbf0-4a1d-8a7a-75e583eefc39 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:27.229694 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b7d29ae1-fbf0-4a1d-8a7a-75e583eefc39 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:27.286713 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-685c0b3b-68fc-4f1a-b9ba-234ed8426a62 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:27.287614 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-685c0b3b-68fc-4f1a-b9ba-234ed8426a62 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:27.293666 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-685c0b3b-68fc-4f1a-b9ba-234ed8426a62 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:27.294139 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-685c0b3b-68fc-4f1a-b9ba-234ed8426a62 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:27.294899 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-685c0b3b-68fc-4f1a-b9ba-234ed8426a62 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:27.295232 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b7d29ae1-fbf0-4a1d-8a7a-75e583eefc39 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.078149 Nov 08 16:14:27.295347 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-685c0b3b-68fc-4f1a-b9ba-234ed8426a62 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:27.295713 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 348/707] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:27 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:14:27.359080 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-685c0b3b-68fc-4f1a-b9ba-234ed8426a62 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.076380 Nov 08 16:14:27.359834 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 360/708] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:27 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:14:27.938383 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-49603019-6868-4451-98bc-3a74302b0148 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:27.939110 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-49603019-6868-4451-98bc-3a74302b0148 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:27.945890 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-49603019-6868-4451-98bc-3a74302b0148 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:27.946335 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-49603019-6868-4451-98bc-3a74302b0148 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:27.947131 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-49603019-6868-4451-98bc-3a74302b0148 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:27.947564 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-49603019-6868-4451-98bc-3a74302b0148 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:27.991553 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-fda37433-4b45-4c01-8e39-b339bbe40091 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:27.992239 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-fda37433-4b45-4c01-8e39-b339bbe40091 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] [instance: 37e5636f-2ecf-4438-8be2-e973029678a1] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:27.999388 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fda37433-4b45-4c01-8e39-b339bbe40091 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:27.999836 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fda37433-4b45-4c01-8e39-b339bbe40091 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:28.000607 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fda37433-4b45-4c01-8e39-b339bbe40091 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:28.001039 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fda37433-4b45-4c01-8e39-b339bbe40091 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:28.016567 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-fda37433-4b45-4c01-8e39-b339bbe40091 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] HTTP exception thrown: Instance 37e5636f-2ecf-4438-8be2-e973029678a1 could not be found. Nov 08 16:14:28.017165 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-fda37433-4b45-4c01-8e39-b339bbe40091 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Returning 404 to user: Instance 37e5636f-2ecf-4438-8be2-e973029678a1 could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:14:28.018019 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-fda37433-4b45-4c01-8e39-b339bbe40091 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1" status: 404 len: 111 microversion: 2.1 time: 0.030432 Nov 08 16:14:28.018785 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 361/709] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:27 2021] GET /compute/v2.1/servers/37e5636f-2ecf-4438-8be2-e973029678a1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 08 16:14:28.094770 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-49603019-6868-4451-98bc-3a74302b0148 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:28.103162 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-49603019-6868-4451-98bc-3a74302b0148 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.169001 Nov 08 16:14:28.103713 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 349/710] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:27 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:28.235693 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-97ec5c68-b74a-4fcc-8cc5-e4966b4ecf74 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:28.236251 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-97ec5c68-b74a-4fcc-8cc5-e4966b4ecf74 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:28.243022 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-97ec5c68-b74a-4fcc-8cc5-e4966b4ecf74 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:28.243478 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-97ec5c68-b74a-4fcc-8cc5-e4966b4ecf74 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:28.244387 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-97ec5c68-b74a-4fcc-8cc5-e4966b4ecf74 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:28.244897 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-97ec5c68-b74a-4fcc-8cc5-e4966b4ecf74 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:28.271286 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-97ec5c68-b74a-4fcc-8cc5-e4966b4ecf74 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Going to try to terminate instance {{(pid=115524) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:14:28.306638 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8a662a7f-a58a-4bb5-b24f-06c143618a3e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:28.308130 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8a662a7f-a58a-4bb5-b24f-06c143618a3e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:28.314362 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8a662a7f-a58a-4bb5-b24f-06c143618a3e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:28.314804 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8a662a7f-a58a-4bb5-b24f-06c143618a3e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:28.315594 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8a662a7f-a58a-4bb5-b24f-06c143618a3e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:28.316033 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8a662a7f-a58a-4bb5-b24f-06c143618a3e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:28.384749 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-97ec5c68-b74a-4fcc-8cc5-e4966b4ecf74 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "DELETE /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 204 len: 0 microversion: 2.1 time: 0.152534 Nov 08 16:14:28.385328 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 362/711] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:14:28 2021] DELETE /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:14:28.393253 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9ed0e383-046c-4021-8d3b-47b05a486ffc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:28.394293 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9ed0e383-046c-4021-8d3b-47b05a486ffc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:28.400514 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ed0e383-046c-4021-8d3b-47b05a486ffc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:28.400961 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ed0e383-046c-4021-8d3b-47b05a486ffc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:28.401771 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ed0e383-046c-4021-8d3b-47b05a486ffc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:28.402212 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ed0e383-046c-4021-8d3b-47b05a486ffc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:28.414389 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8a662a7f-a58a-4bb5-b24f-06c143618a3e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.111330 Nov 08 16:14:28.415036 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 350/712] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:28 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:14:28.419985 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-faa0dad0-c54b-431a-96c3-2a75cad78dc6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:28.420874 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-faa0dad0-c54b-431a-96c3-2a75cad78dc6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:28.428475 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-faa0dad0-c54b-431a-96c3-2a75cad78dc6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:28.428852 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-faa0dad0-c54b-431a-96c3-2a75cad78dc6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:28.429627 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-faa0dad0-c54b-431a-96c3-2a75cad78dc6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:28.430138 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-faa0dad0-c54b-431a-96c3-2a75cad78dc6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:28.475823 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9ed0e383-046c-4021-8d3b-47b05a486ffc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.086143 Nov 08 16:14:28.476598 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 363/713] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:28 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:14:28.572890 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-faa0dad0-c54b-431a-96c3-2a75cad78dc6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:28.580404 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-faa0dad0-c54b-431a-96c3-2a75cad78dc6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1513 microversion: 2.1 time: 0.164073 Nov 08 16:14:28.581058 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 351/714] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:28 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:29.120488 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-55f7dfc7-8250-4464-b125-c7fbf3a842d2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:29.121172 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-55f7dfc7-8250-4464-b125-c7fbf3a842d2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:29.128167 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-55f7dfc7-8250-4464-b125-c7fbf3a842d2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:29.128606 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-55f7dfc7-8250-4464-b125-c7fbf3a842d2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:29.129368 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-55f7dfc7-8250-4464-b125-c7fbf3a842d2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:29.129831 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-55f7dfc7-8250-4464-b125-c7fbf3a842d2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:29.255521 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-55f7dfc7-8250-4464-b125-c7fbf3a842d2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:29.263343 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-55f7dfc7-8250-4464-b125-c7fbf3a842d2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.146907 Nov 08 16:14:29.263921 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 364/715] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:29 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:29.425228 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4c9b1c93-a1ea-4803-a654-33683bba3aa8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:29.426213 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4c9b1c93-a1ea-4803-a654-33683bba3aa8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:29.432493 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4c9b1c93-a1ea-4803-a654-33683bba3aa8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:29.432935 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4c9b1c93-a1ea-4803-a654-33683bba3aa8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:29.433700 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4c9b1c93-a1ea-4803-a654-33683bba3aa8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:29.434152 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4c9b1c93-a1ea-4803-a654-33683bba3aa8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:29.487496 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bc79ff77-da1c-448c-a3cc-ac31861a518d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:29.488321 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-bc79ff77-da1c-448c-a3cc-ac31861a518d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:29.494480 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bc79ff77-da1c-448c-a3cc-ac31861a518d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:29.494920 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bc79ff77-da1c-448c-a3cc-ac31861a518d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:29.495678 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bc79ff77-da1c-448c-a3cc-ac31861a518d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:29.496101 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bc79ff77-da1c-448c-a3cc-ac31861a518d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:33.241376 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bc79ff77-da1c-448c-a3cc-ac31861a518d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 3.757326 Nov 08 16:14:33.242302 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 365/716] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:29 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 3759 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:14:33.247544 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1f12dd93-292a-4151-98dd-8ffff6bfc0be tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:33.247719 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4c9b1c93-a1ea-4803-a654-33683bba3aa8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 3.825647 Nov 08 16:14:33.251289 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 352/717] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:29 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 3827 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:14:33.251424 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1f12dd93-292a-4151-98dd-8ffff6bfc0be tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:33.253016 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0b59551d-a44a-4e43-a621-10ab58d71c89 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:33.253947 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0b59551d-a44a-4e43-a621-10ab58d71c89 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:33.255446 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1f12dd93-292a-4151-98dd-8ffff6bfc0be tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:33.255897 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1f12dd93-292a-4151-98dd-8ffff6bfc0be tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:33.256687 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1f12dd93-292a-4151-98dd-8ffff6bfc0be tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:33.257126 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1f12dd93-292a-4151-98dd-8ffff6bfc0be tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:33.260512 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0b59551d-a44a-4e43-a621-10ab58d71c89 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:33.260948 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0b59551d-a44a-4e43-a621-10ab58d71c89 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:33.261741 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0b59551d-a44a-4e43-a621-10ab58d71c89 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:33.262165 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0b59551d-a44a-4e43-a621-10ab58d71c89 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:33.451207 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0b59551d-a44a-4e43-a621-10ab58d71c89 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:33.454687 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1f12dd93-292a-4151-98dd-8ffff6bfc0be tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:33.459688 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0b59551d-a44a-4e43-a621-10ab58d71c89 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.210342 Nov 08 16:14:33.460521 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 353/718] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:33 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:33.462493 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1f12dd93-292a-4151-98dd-8ffff6bfc0be tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1513 microversion: 2.1 time: 0.218922 Nov 08 16:14:33.463053 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 366/719] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:33 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:34.253109 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-bfb9cd80-19ce-47cc-b822-5d8f182fb9ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:34.254039 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-bfb9cd80-19ce-47cc-b822-5d8f182fb9ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:34.258781 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1636f347-a453-4342-8371-ff6e28b2f196 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:34.259744 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1636f347-a453-4342-8371-ff6e28b2f196 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:34.260212 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bfb9cd80-19ce-47cc-b822-5d8f182fb9ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:34.260649 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bfb9cd80-19ce-47cc-b822-5d8f182fb9ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:34.261603 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bfb9cd80-19ce-47cc-b822-5d8f182fb9ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:34.262050 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bfb9cd80-19ce-47cc-b822-5d8f182fb9ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:34.266005 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1636f347-a453-4342-8371-ff6e28b2f196 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:34.266455 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1636f347-a453-4342-8371-ff6e28b2f196 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:34.267222 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1636f347-a453-4342-8371-ff6e28b2f196 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:34.267652 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1636f347-a453-4342-8371-ff6e28b2f196 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:35.147505 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 16:14:35.147652 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: Mon Nov 8 16:14:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action (ip 10.222.0.37) !!! Nov 08 16:14:37.967795 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-bfb9cd80-19ce-47cc-b822-5d8f182fb9ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 3.718188 Nov 08 16:14:37.971601 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 354/720] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:34 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 3720 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:14:37.973346 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b3f3331d-27ef-4506-b7c6-de41ec627213 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:37.974063 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b3f3331d-27ef-4506-b7c6-de41ec627213 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:37.977242 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1636f347-a453-4342-8371-ff6e28b2f196 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 3.721641 Nov 08 16:14:37.977686 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 367/721] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:34 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 3723 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:14:37.980945 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b3f3331d-27ef-4506-b7c6-de41ec627213 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:37.981390 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b3f3331d-27ef-4506-b7c6-de41ec627213 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:37.982190 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b3f3331d-27ef-4506-b7c6-de41ec627213 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:37.982356 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d0bfd9a3-9812-4db7-a2cd-7e128d418cfa tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:37.982623 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b3f3331d-27ef-4506-b7c6-de41ec627213 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:37.983055 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d0bfd9a3-9812-4db7-a2cd-7e128d418cfa tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:37.990099 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d0bfd9a3-9812-4db7-a2cd-7e128d418cfa tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:37.990547 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d0bfd9a3-9812-4db7-a2cd-7e128d418cfa tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:37.991319 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d0bfd9a3-9812-4db7-a2cd-7e128d418cfa tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:37.991753 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d0bfd9a3-9812-4db7-a2cd-7e128d418cfa tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:38.176429 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b3f3331d-27ef-4506-b7c6-de41ec627213 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:38.183049 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-d0bfd9a3-9812-4db7-a2cd-7e128d418cfa tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:38.184119 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b3f3331d-27ef-4506-b7c6-de41ec627213 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1566 microversion: 2.1 time: 0.214417 Nov 08 16:14:38.184681 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 355/722] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:37 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1566 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:38.190275 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d0bfd9a3-9812-4db7-a2cd-7e128d418cfa tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1513 microversion: 2.1 time: 0.211621 Nov 08 16:14:38.190822 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 368/723] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:37 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:38.980211 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-84a12d59-39c6-42aa-a0e3-301dac5c85b5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:38.981233 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-84a12d59-39c6-42aa-a0e3-301dac5c85b5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:38.987675 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84a12d59-39c6-42aa-a0e3-301dac5c85b5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:38.988569 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84a12d59-39c6-42aa-a0e3-301dac5c85b5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:38.989384 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a1e3e077-c59c-4a71-872c-f6e0c0b2a242 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:38.989909 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84a12d59-39c6-42aa-a0e3-301dac5c85b5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:38.990140 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84a12d59-39c6-42aa-a0e3-301dac5c85b5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:38.990373 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a1e3e077-c59c-4a71-872c-f6e0c0b2a242 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:38.996752 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a1e3e077-c59c-4a71-872c-f6e0c0b2a242 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:38.997468 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a1e3e077-c59c-4a71-872c-f6e0c0b2a242 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:38.998275 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a1e3e077-c59c-4a71-872c-f6e0c0b2a242 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:38.998792 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a1e3e077-c59c-4a71-872c-f6e0c0b2a242 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:39.298196 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-84a12d59-39c6-42aa-a0e3-301dac5c85b5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.322499 Nov 08 16:14:39.298902 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 356/724] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:38 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:14:39.305129 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a9238ba0-522e-4069-b129-84087f3c76f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:39.305824 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a9238ba0-522e-4069-b129-84087f3c76f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:39.312036 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a9238ba0-522e-4069-b129-84087f3c76f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:39.312467 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a9238ba0-522e-4069-b129-84087f3c76f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:39.313222 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a9238ba0-522e-4069-b129-84087f3c76f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:39.313646 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a9238ba0-522e-4069-b129-84087f3c76f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:39.439579 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a9238ba0-522e-4069-b129-84087f3c76f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:39.447621 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a9238ba0-522e-4069-b129-84087f3c76f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1546 microversion: 2.1 time: 0.147644 Nov 08 16:14:39.448165 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 357/725] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:39 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1546 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:39.452253 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-cb5b732f-93fd-4db4-8076-82e608bb9c6d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:39.452836 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-cb5b732f-93fd-4db4-8076-82e608bb9c6d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:39.458132 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cb5b732f-93fd-4db4-8076-82e608bb9c6d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:39.458817 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cb5b732f-93fd-4db4-8076-82e608bb9c6d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:39.459350 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cb5b732f-93fd-4db4-8076-82e608bb9c6d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:39.459769 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cb5b732f-93fd-4db4-8076-82e608bb9c6d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:39.583943 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-cb5b732f-93fd-4db4-8076-82e608bb9c6d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:39.590996 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-cb5b732f-93fd-4db4-8076-82e608bb9c6d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1513 microversion: 2.1 time: 0.141913 Nov 08 16:14:39.591544 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 358/726] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:39 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1513 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:39.595777 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-53803f23-bf65-4f23-a42d-accd8eba1d0d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:39.596253 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-53803f23-bf65-4f23-a42d-accd8eba1d0d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:39.602017 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-53803f23-bf65-4f23-a42d-accd8eba1d0d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:39.602453 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-53803f23-bf65-4f23-a42d-accd8eba1d0d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:39.603209 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-53803f23-bf65-4f23-a42d-accd8eba1d0d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:39.603630 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-53803f23-bf65-4f23-a42d-accd8eba1d0d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:39.678832 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-53803f23-bf65-4f23-a42d-accd8eba1d0d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] HTTP exception thrown: Cannot 'detach_volume' instance 44f7e3a8-0064-42ad-9e41-03a1ba050703 while it is in vm_state rescued Nov 08 16:14:39.679427 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-53803f23-bf65-4f23-a42d-accd8eba1d0d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Returning 409 to user: Cannot 'detach_volume' instance 44f7e3a8-0064-42ad-9e41-03a1ba050703 while it is in vm_state rescued {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:14:39.680256 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-53803f23-bf65-4f23-a42d-accd8eba1d0d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "DELETE /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/os-volume_attachments/56d2fe1f-b380-431c-8242-f9db69bda9ac" status: 409 len: 152 microversion: 2.1 time: 0.087823 Nov 08 16:14:39.680829 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 359/727] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Nov 8 16:14:39 2021] DELETE /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/os-volume_attachments/56d2fe1f-b380-431c-8242-f9db69bda9ac => generated 152 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 08 16:14:39.688628 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9faf1242-d19b-4d07-b04f-e8d811857367 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:39.689112 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-9faf1242-d19b-4d07-b04f-e8d811857367 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:39.694547 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9faf1242-d19b-4d07-b04f-e8d811857367 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:39.694978 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9faf1242-d19b-4d07-b04f-e8d811857367 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:39.695733 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9faf1242-d19b-4d07-b04f-e8d811857367 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:39.696154 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9faf1242-d19b-4d07-b04f-e8d811857367 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:39.757740 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-9faf1242-d19b-4d07-b04f-e8d811857367 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "POST /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/action" status: 202 len: 0 microversion: 2.1 time: 0.072368 Nov 08 16:14:39.758346 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 360/728] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:39 2021] POST /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:14:39.766586 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d03d3110-ebcc-496c-981f-73da263ce2cd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:39.767255 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d03d3110-ebcc-496c-981f-73da263ce2cd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:39.773483 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d03d3110-ebcc-496c-981f-73da263ce2cd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:39.773953 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d03d3110-ebcc-496c-981f-73da263ce2cd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:39.774715 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d03d3110-ebcc-496c-981f-73da263ce2cd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:39.775140 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d03d3110-ebcc-496c-981f-73da263ce2cd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:39.784059 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a1e3e077-c59c-4a71-872c-f6e0c0b2a242 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.799070 Nov 08 16:14:39.784739 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 369/729] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:38 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:14:39.906765 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d03d3110-ebcc-496c-981f-73da263ce2cd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:39.914871 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d03d3110-ebcc-496c-981f-73da263ce2cd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1554 microversion: 2.1 time: 0.151920 Nov 08 16:14:39.915427 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 361/730] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:39 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:14:40.310717 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b97b47a5-b6ec-4f3d-a4f3-9007615553cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:40.311713 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b97b47a5-b6ec-4f3d-a4f3-9007615553cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:40.319081 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b97b47a5-b6ec-4f3d-a4f3-9007615553cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:40.319525 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b97b47a5-b6ec-4f3d-a4f3-9007615553cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:40.320289 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b97b47a5-b6ec-4f3d-a4f3-9007615553cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:40.320723 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b97b47a5-b6ec-4f3d-a4f3-9007615553cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:40.608084 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-fd9d8e06-de17-4606-a1d0-8eae6b8c3f21 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:40.608688 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fd9d8e06-de17-4606-a1d0-8eae6b8c3f21 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:40.615430 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fd9d8e06-de17-4606-a1d0-8eae6b8c3f21 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:40.615861 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fd9d8e06-de17-4606-a1d0-8eae6b8c3f21 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:40.616625 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fd9d8e06-de17-4606-a1d0-8eae6b8c3f21 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:40.617052 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fd9d8e06-de17-4606-a1d0-8eae6b8c3f21 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:40.742486 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fd9d8e06-de17-4606-a1d0-8eae6b8c3f21 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:40.749904 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-fd9d8e06-de17-4606-a1d0-8eae6b8c3f21 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1513 microversion: 2.1 time: 0.145530 Nov 08 16:14:40.750457 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 362/731] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:40 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:14:40.796102 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5b1d6051-e383-4aa0-a84c-28810ed72448 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:40.797164 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5b1d6051-e383-4aa0-a84c-28810ed72448 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:40.803562 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b1d6051-e383-4aa0-a84c-28810ed72448 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:40.803992 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b1d6051-e383-4aa0-a84c-28810ed72448 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:40.804742 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b1d6051-e383-4aa0-a84c-28810ed72448 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:40.805162 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b1d6051-e383-4aa0-a84c-28810ed72448 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:42.867395 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b97b47a5-b6ec-4f3d-a4f3-9007615553cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 2.560529 Nov 08 16:14:42.868677 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 370/732] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:40 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 2563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:14:42.871906 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5b1d6051-e383-4aa0-a84c-28810ed72448 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 2.078493 Nov 08 16:14:42.874555 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ff582879-397a-4254-9b10-adef78f70f07 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:42.875325 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ff582879-397a-4254-9b10-adef78f70f07 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:42.876592 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 363/733] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:40 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 2085 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:14:42.882553 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-eb1f85f9-5368-434b-be56-4d990c47dbe9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:42.882870 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-eb1f85f9-5368-434b-be56-4d990c47dbe9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:42.883489 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ff582879-397a-4254-9b10-adef78f70f07 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:42.883945 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ff582879-397a-4254-9b10-adef78f70f07 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:42.884728 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ff582879-397a-4254-9b10-adef78f70f07 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:42.885165 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ff582879-397a-4254-9b10-adef78f70f07 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:42.889692 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eb1f85f9-5368-434b-be56-4d990c47dbe9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:42.890288 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eb1f85f9-5368-434b-be56-4d990c47dbe9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:42.891055 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eb1f85f9-5368-434b-be56-4d990c47dbe9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:42.891476 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eb1f85f9-5368-434b-be56-4d990c47dbe9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:43.391077 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-eb1f85f9-5368-434b-be56-4d990c47dbe9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:43.399000 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-ff582879-397a-4254-9b10-adef78f70f07 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:43.399141 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-eb1f85f9-5368-434b-be56-4d990c47dbe9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1513 microversion: 2.1 time: 0.521336 Nov 08 16:14:43.399799 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 364/734] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:42 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1513 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:43.407457 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ff582879-397a-4254-9b10-adef78f70f07 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1554 microversion: 2.1 time: 0.537282 Nov 08 16:14:43.413379 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 371/735] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:42 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1554 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:43.879775 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c1b7658e-1ae7-406d-a8f0-51bf449a9945 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:43.880678 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c1b7658e-1ae7-406d-a8f0-51bf449a9945 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:43.884158 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4a832447-3ae1-42be-9fc5-6ac4ef56c697 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:43.885078 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4a832447-3ae1-42be-9fc5-6ac4ef56c697 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:43.889012 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c1b7658e-1ae7-406d-a8f0-51bf449a9945 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:43.889601 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c1b7658e-1ae7-406d-a8f0-51bf449a9945 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:43.890408 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c1b7658e-1ae7-406d-a8f0-51bf449a9945 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:43.890837 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c1b7658e-1ae7-406d-a8f0-51bf449a9945 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:43.892205 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a832447-3ae1-42be-9fc5-6ac4ef56c697 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:43.892663 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a832447-3ae1-42be-9fc5-6ac4ef56c697 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:43.893451 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a832447-3ae1-42be-9fc5-6ac4ef56c697 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:43.894579 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a832447-3ae1-42be-9fc5-6ac4ef56c697 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:44.006475 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4a832447-3ae1-42be-9fc5-6ac4ef56c697 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.125379 Nov 08 16:14:44.007496 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 372/736] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:43 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:14:44.009832 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c1b7658e-1ae7-406d-a8f0-51bf449a9945 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.133461 Nov 08 16:14:44.009832 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 365/737] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:43 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:14:44.283359 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-e9bbd5f9-09b6-4486-9e4c-c1616cc1a044 req-128cfe6a-fe0c-41c5-a791-6eb1bfd97e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1400ac35-c2ae-4814-ac9b-d18094175dce", "name": "network-vif-deleted", "tag": "b2d31fb8-0a87-4aea-8200-914cd468d395"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:44.284582 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:14:44.284582 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:14:44.292088 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-e9bbd5f9-09b6-4486-9e4c-c1616cc1a044 req-128cfe6a-fe0c-41c5-a791-6eb1bfd97e82 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:44.292554 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-e9bbd5f9-09b6-4486-9e4c-c1616cc1a044 req-128cfe6a-fe0c-41c5-a791-6eb1bfd97e82 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:44.305035 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-e9bbd5f9-09b6-4486-9e4c-c1616cc1a044 req-128cfe6a-fe0c-41c5-a791-6eb1bfd97e82 service nova] Creating event network-vif-deleted:b2d31fb8-0a87-4aea-8200-914cd468d395 for instance 1400ac35-c2ae-4814-ac9b-d18094175dce on hv-cinder-81618 Nov 08 16:14:44.309894 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-e9bbd5f9-09b6-4486-9e4c-c1616cc1a044 req-128cfe6a-fe0c-41c5-a791-6eb1bfd97e82 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030689 Nov 08 16:14:44.310846 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 373/738] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:14:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:14:44.415935 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3f49ea1b-b224-44fe-a2df-350d298e95d1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:44.416623 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3f49ea1b-b224-44fe-a2df-350d298e95d1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:44.428790 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3f49ea1b-b224-44fe-a2df-350d298e95d1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:44.429514 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3f49ea1b-b224-44fe-a2df-350d298e95d1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:44.430463 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-288c6094-6575-4a81-8d0c-cdba2f69ef00 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:44.430916 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3f49ea1b-b224-44fe-a2df-350d298e95d1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:44.431147 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-288c6094-6575-4a81-8d0c-cdba2f69ef00 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:44.431696 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3f49ea1b-b224-44fe-a2df-350d298e95d1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:44.447721 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-288c6094-6575-4a81-8d0c-cdba2f69ef00 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:44.447971 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-288c6094-6575-4a81-8d0c-cdba2f69ef00 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:44.449839 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-288c6094-6575-4a81-8d0c-cdba2f69ef00 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:44.451008 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-288c6094-6575-4a81-8d0c-cdba2f69ef00 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:44.464489 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3f49ea1b-b224-44fe-a2df-350d298e95d1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:44.464934 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3f49ea1b-b224-44fe-a2df-350d298e95d1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:44.465383 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.objects.instance [None req-3f49ea1b-b224-44fe-a2df-350d298e95d1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lazy-loading 'fault' on Instance uuid 1400ac35-c2ae-4814-ac9b-d18094175dce {{(pid=115523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:14:44.512448 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3f49ea1b-b224-44fe-a2df-350d298e95d1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:44.520722 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3f49ea1b-b224-44fe-a2df-350d298e95d1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 200 len: 1307 microversion: 2.1 time: 0.108744 Nov 08 16:14:44.521602 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 366/739] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:44 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:44.609536 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-288c6094-6575-4a81-8d0c-cdba2f69ef00 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:44.617986 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-288c6094-6575-4a81-8d0c-cdba2f69ef00 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1554 microversion: 2.1 time: 0.191498 Nov 08 16:14:44.618557 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 374/740] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:44 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1554 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:45.018014 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-2a0e3d48-d83c-468a-8819-3afeb945582e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:45.019651 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-2a0e3d48-d83c-468a-8819-3afeb945582e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:45.020656 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3a68dd2a-7335-40cd-9e1f-fa7b4f8c2ede tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:45.021604 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3a68dd2a-7335-40cd-9e1f-fa7b4f8c2ede tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:45.026521 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2a0e3d48-d83c-468a-8819-3afeb945582e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:45.027062 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2a0e3d48-d83c-468a-8819-3afeb945582e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:45.027898 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2a0e3d48-d83c-468a-8819-3afeb945582e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:45.028357 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3a68dd2a-7335-40cd-9e1f-fa7b4f8c2ede tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:45.028517 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2a0e3d48-d83c-468a-8819-3afeb945582e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:45.028811 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3a68dd2a-7335-40cd-9e1f-fa7b4f8c2ede tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:45.029586 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3a68dd2a-7335-40cd-9e1f-fa7b4f8c2ede tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:45.030058 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3a68dd2a-7335-40cd-9e1f-fa7b4f8c2ede tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:45.128960 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-2a0e3d48-d83c-468a-8819-3afeb945582e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.114084 Nov 08 16:14:45.130515 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 367/741] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:45 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:14:45.541938 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-754267a5-8309-4e49-b8e3-952dd5779ab2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:45.542901 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-754267a5-8309-4e49-b8e3-952dd5779ab2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 1400ac35-c2ae-4814-ac9b-d18094175dce] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:45.561437 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-754267a5-8309-4e49-b8e3-952dd5779ab2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:45.565003 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-754267a5-8309-4e49-b8e3-952dd5779ab2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:45.567590 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-754267a5-8309-4e49-b8e3-952dd5779ab2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:45.568037 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-754267a5-8309-4e49-b8e3-952dd5779ab2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:45.596094 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-754267a5-8309-4e49-b8e3-952dd5779ab2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] HTTP exception thrown: Instance 1400ac35-c2ae-4814-ac9b-d18094175dce could not be found. Nov 08 16:14:45.596641 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-754267a5-8309-4e49-b8e3-952dd5779ab2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Returning 404 to user: Instance 1400ac35-c2ae-4814-ac9b-d18094175dce could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:14:45.603026 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-754267a5-8309-4e49-b8e3-952dd5779ab2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce" status: 404 len: 111 microversion: 2.1 time: 0.063985 Nov 08 16:14:45.603613 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 368/742] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:45 2021] GET /compute/v2.1/servers/1400ac35-c2ae-4814-ac9b-d18094175dce => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:14:45.619172 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-de3a47f1-b03d-409a-8f51-2681fba7448d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:45.619690 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-de3a47f1-b03d-409a-8f51-2681fba7448d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:45.626618 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-de3a47f1-b03d-409a-8f51-2681fba7448d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:45.627313 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-de3a47f1-b03d-409a-8f51-2681fba7448d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:45.629985 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-de3a47f1-b03d-409a-8f51-2681fba7448d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:45.630603 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-de3a47f1-b03d-409a-8f51-2681fba7448d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:45.662483 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-de3a47f1-b03d-409a-8f51-2681fba7448d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Going to try to terminate instance {{(pid=115523) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:14:45.791245 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-de3a47f1-b03d-409a-8f51-2681fba7448d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "DELETE /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 204 len: 0 microversion: 2.1 time: 0.181610 Nov 08 16:14:45.792283 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 369/743] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:14:45 2021] DELETE /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:14:45.802055 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-14df833a-4fca-4e87-bd2e-df49bf5e17cb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:45.803818 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-14df833a-4fca-4e87-bd2e-df49bf5e17cb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:45.832345 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-14df833a-4fca-4e87-bd2e-df49bf5e17cb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:45.833387 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-14df833a-4fca-4e87-bd2e-df49bf5e17cb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:45.834602 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-14df833a-4fca-4e87-bd2e-df49bf5e17cb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:45.835276 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-14df833a-4fca-4e87-bd2e-df49bf5e17cb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:46.029119 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-14df833a-4fca-4e87-bd2e-df49bf5e17cb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:46.040653 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-14df833a-4fca-4e87-bd2e-df49bf5e17cb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1554 microversion: 2.1 time: 0.246753 Nov 08 16:14:46.041231 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 370/744] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:45 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1554 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:46.049679 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-24945ac7-3dc8-4f76-87fa-b3cee0eb13e2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:46.053746 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-24945ac7-3dc8-4f76-87fa-b3cee0eb13e2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:46.059784 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-24945ac7-3dc8-4f76-87fa-b3cee0eb13e2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:46.062401 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-24945ac7-3dc8-4f76-87fa-b3cee0eb13e2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:46.066851 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-24945ac7-3dc8-4f76-87fa-b3cee0eb13e2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:46.067494 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-24945ac7-3dc8-4f76-87fa-b3cee0eb13e2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:46.242054 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3a68dd2a-7335-40cd-9e1f-fa7b4f8c2ede tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 1.225337 Nov 08 16:14:46.247891 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 375/745] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:45 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:14:46.254159 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e41bd9ac-84ed-43b9-8044-5d2fff74f538 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:46.257451 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-24945ac7-3dc8-4f76-87fa-b3cee0eb13e2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:46.259135 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e41bd9ac-84ed-43b9-8044-5d2fff74f538 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:46.267843 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-24945ac7-3dc8-4f76-87fa-b3cee0eb13e2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 200 len: 1513 microversion: 2.1 time: 0.225396 Nov 08 16:14:46.269826 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 371/746] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:46 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:46.271846 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e41bd9ac-84ed-43b9-8044-5d2fff74f538 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:46.272262 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e41bd9ac-84ed-43b9-8044-5d2fff74f538 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:46.273432 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e41bd9ac-84ed-43b9-8044-5d2fff74f538 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:46.273912 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e41bd9ac-84ed-43b9-8044-5d2fff74f538 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:47.059660 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c68973e0-41ea-46ca-a4ba-21137d5160d8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:47.060890 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c68973e0-41ea-46ca-a4ba-21137d5160d8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:47.071231 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c68973e0-41ea-46ca-a4ba-21137d5160d8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:47.072659 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c68973e0-41ea-46ca-a4ba-21137d5160d8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:47.073794 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c68973e0-41ea-46ca-a4ba-21137d5160d8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:47.074502 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c68973e0-41ea-46ca-a4ba-21137d5160d8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:47.239336 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c68973e0-41ea-46ca-a4ba-21137d5160d8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:47.249616 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c68973e0-41ea-46ca-a4ba-21137d5160d8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1554 microversion: 2.1 time: 0.191763 Nov 08 16:14:47.250722 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 372/747] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:47 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1554 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:14:47.255355 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-bf541b96-4884-4845-986d-0bf4fe1de961 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:47.256524 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-bf541b96-4884-4845-986d-0bf4fe1de961 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:47.262540 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bf541b96-4884-4845-986d-0bf4fe1de961 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:47.262980 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bf541b96-4884-4845-986d-0bf4fe1de961 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:47.263941 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bf541b96-4884-4845-986d-0bf4fe1de961 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:47.264594 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bf541b96-4884-4845-986d-0bf4fe1de961 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:49.724582 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e41bd9ac-84ed-43b9-8044-5d2fff74f538 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 3.474691 Nov 08 16:14:49.725694 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 376/748] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:46 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 3477 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:14:49.730339 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-bf541b96-4884-4845-986d-0bf4fe1de961 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 2.478122 Nov 08 16:14:49.731833 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f98d5d0e-0436-4c9c-9e21-41a10268faa7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:49.731973 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 373/749] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:47 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 2480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:14:49.732064 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f98d5d0e-0436-4c9c-9e21-41a10268faa7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:49.738206 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0c59ef52-c47b-41a9-979a-bd00a32b0bbc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:49.742526 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0c59ef52-c47b-41a9-979a-bd00a32b0bbc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:49.742687 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f98d5d0e-0436-4c9c-9e21-41a10268faa7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:49.743076 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f98d5d0e-0436-4c9c-9e21-41a10268faa7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:49.744060 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f98d5d0e-0436-4c9c-9e21-41a10268faa7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:49.744664 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f98d5d0e-0436-4c9c-9e21-41a10268faa7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:49.765635 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0c59ef52-c47b-41a9-979a-bd00a32b0bbc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:49.766389 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0c59ef52-c47b-41a9-979a-bd00a32b0bbc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:49.767727 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0c59ef52-c47b-41a9-979a-bd00a32b0bbc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:49.768164 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0c59ef52-c47b-41a9-979a-bd00a32b0bbc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:49.932765 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f98d5d0e-0436-4c9c-9e21-41a10268faa7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:49.951292 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f98d5d0e-0436-4c9c-9e21-41a10268faa7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 200 len: 1513 microversion: 2.1 time: 0.224069 Nov 08 16:14:49.953461 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 377/750] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:49 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:50.028385 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0c59ef52-c47b-41a9-979a-bd00a32b0bbc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:50.037420 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0c59ef52-c47b-41a9-979a-bd00a32b0bbc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1554 microversion: 2.1 time: 0.304694 Nov 08 16:14:50.038456 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 374/751] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:49 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1554 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:50.743896 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4d9aeabb-d04f-416b-9ed9-c2f1b602d54f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:50.746113 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1ad5843d-fc22-420f-997d-2aec544f2b7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:50.747939 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4d9aeabb-d04f-416b-9ed9-c2f1b602d54f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:50.749439 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1ad5843d-fc22-420f-997d-2aec544f2b7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:50.762483 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1ad5843d-fc22-420f-997d-2aec544f2b7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:50.763601 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4d9aeabb-d04f-416b-9ed9-c2f1b602d54f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:50.764274 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4d9aeabb-d04f-416b-9ed9-c2f1b602d54f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:50.764921 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1ad5843d-fc22-420f-997d-2aec544f2b7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:50.766065 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4d9aeabb-d04f-416b-9ed9-c2f1b602d54f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:50.767031 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1ad5843d-fc22-420f-997d-2aec544f2b7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:50.767661 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4d9aeabb-d04f-416b-9ed9-c2f1b602d54f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:50.768295 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1ad5843d-fc22-420f-997d-2aec544f2b7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:50.894175 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4d9aeabb-d04f-416b-9ed9-c2f1b602d54f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.153130 Nov 08 16:14:50.895400 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 375/752] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:50 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:14:50.917848 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1ad5843d-fc22-420f-997d-2aec544f2b7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.184555 Nov 08 16:14:50.922074 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 378/753] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:50 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:14:50.972446 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a7728dab-f592-4fde-9157-208b0c0760d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:50.973440 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a7728dab-f592-4fde-9157-208b0c0760d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:50.983030 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a7728dab-f592-4fde-9157-208b0c0760d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:50.984876 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a7728dab-f592-4fde-9157-208b0c0760d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:50.986302 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a7728dab-f592-4fde-9157-208b0c0760d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:50.987019 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a7728dab-f592-4fde-9157-208b0c0760d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:51.055625 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0e7c480a-3f62-420e-b9f3-9030da1a0766 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:51.056764 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0e7c480a-3f62-420e-b9f3-9030da1a0766 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:51.070420 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0e7c480a-3f62-420e-b9f3-9030da1a0766 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:51.072235 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0e7c480a-3f62-420e-b9f3-9030da1a0766 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:51.074162 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0e7c480a-3f62-420e-b9f3-9030da1a0766 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:51.075551 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0e7c480a-3f62-420e-b9f3-9030da1a0766 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:51.322254 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a7728dab-f592-4fde-9157-208b0c0760d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:51.330859 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a7728dab-f592-4fde-9157-208b0c0760d4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 200 len: 1513 microversion: 2.1 time: 0.364134 Nov 08 16:14:51.341349 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 376/754] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:50 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 1513 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:51.404540 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0e7c480a-3f62-420e-b9f3-9030da1a0766 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:51.413315 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0e7c480a-3f62-420e-b9f3-9030da1a0766 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1554 microversion: 2.1 time: 0.362242 Nov 08 16:14:51.423271 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 379/755] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:51 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1554 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:51.906728 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e6e689e5-53ab-4138-80b1-2ec94d463c5a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:51.907824 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e6e689e5-53ab-4138-80b1-2ec94d463c5a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:51.915342 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e6e689e5-53ab-4138-80b1-2ec94d463c5a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:51.915799 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e6e689e5-53ab-4138-80b1-2ec94d463c5a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:51.916588 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e6e689e5-53ab-4138-80b1-2ec94d463c5a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:51.917252 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e6e689e5-53ab-4138-80b1-2ec94d463c5a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:51.930786 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2af88385-c989-4f5b-a80d-e7f8c71cd45f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:51.931787 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2af88385-c989-4f5b-a80d-e7f8c71cd45f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:51.947357 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2af88385-c989-4f5b-a80d-e7f8c71cd45f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:51.947818 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2af88385-c989-4f5b-a80d-e7f8c71cd45f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:51.948658 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2af88385-c989-4f5b-a80d-e7f8c71cd45f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:51.949092 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2af88385-c989-4f5b-a80d-e7f8c71cd45f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:55.874274 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e6e689e5-53ab-4138-80b1-2ec94d463c5a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 3.971154 Nov 08 16:14:55.878652 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 377/756] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:51 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 3974 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:14:55.881105 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6858aebc-210a-4040-93be-2065820b1313 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:55.881832 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6858aebc-210a-4040-93be-2065820b1313 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:55.889112 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6858aebc-210a-4040-93be-2065820b1313 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:55.889542 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6858aebc-210a-4040-93be-2065820b1313 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:55.890465 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6858aebc-210a-4040-93be-2065820b1313 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:55.890897 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6858aebc-210a-4040-93be-2065820b1313 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:55.911289 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2af88385-c989-4f5b-a80d-e7f8c71cd45f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 3.977316 Nov 08 16:14:55.911289 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 380/757] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:51 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 3983 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:14:55.923297 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d8a6de5d-e98a-4930-b847-483ab04a5281 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:55.923979 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d8a6de5d-e98a-4930-b847-483ab04a5281 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:55.932869 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d8a6de5d-e98a-4930-b847-483ab04a5281 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:55.933384 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d8a6de5d-e98a-4930-b847-483ab04a5281 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:55.934740 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d8a6de5d-e98a-4930-b847-483ab04a5281 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:55.934740 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d8a6de5d-e98a-4930-b847-483ab04a5281 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:56.121441 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6858aebc-210a-4040-93be-2065820b1313 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:56.129946 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6858aebc-210a-4040-93be-2065820b1313 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 200 len: 1513 microversion: 2.1 time: 0.252558 Nov 08 16:14:56.131040 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 378/758] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:55 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 1513 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:56.138238 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-d8a6de5d-e98a-4930-b847-483ab04a5281 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:56.145864 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d8a6de5d-e98a-4930-b847-483ab04a5281 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1554 microversion: 2.1 time: 0.235548 Nov 08 16:14:56.146451 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 381/759] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:55 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1554 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:56.887237 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-153b28b5-aa1c-44d5-9a41-dd3b76a87849 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:56.888986 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-153b28b5-aa1c-44d5-9a41-dd3b76a87849 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:56.903073 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-153b28b5-aa1c-44d5-9a41-dd3b76a87849 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:56.903776 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-153b28b5-aa1c-44d5-9a41-dd3b76a87849 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:56.906973 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-153b28b5-aa1c-44d5-9a41-dd3b76a87849 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:56.907681 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-153b28b5-aa1c-44d5-9a41-dd3b76a87849 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:56.916686 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-983fc54a-776c-4226-bb69-27fdde3f1e9f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:56.918296 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-983fc54a-776c-4226-bb69-27fdde3f1e9f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:56.929757 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-983fc54a-776c-4226-bb69-27fdde3f1e9f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:56.930609 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-983fc54a-776c-4226-bb69-27fdde3f1e9f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:56.931719 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-983fc54a-776c-4226-bb69-27fdde3f1e9f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:56.933738 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-983fc54a-776c-4226-bb69-27fdde3f1e9f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:57.020061 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-153b28b5-aa1c-44d5-9a41-dd3b76a87849 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.137119 Nov 08 16:14:57.020858 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 379/760] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:56 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:14:57.026279 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-c9d88ff2-a456-4e42-8b2d-bebaada781a6 req-acd0caa0-5be8-4aca-848e-8297ec02f99d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "333fb179-0416-4534-95d0-4d9f3a9478f0", "name": "network-vif-deleted", "tag": "d14efac8-b33a-4eb0-b610-32a9bf41b972"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:57.027955 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:14:57.027955 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:14:57.036157 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-c9d88ff2-a456-4e42-8b2d-bebaada781a6 req-acd0caa0-5be8-4aca-848e-8297ec02f99d service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:57.036865 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-c9d88ff2-a456-4e42-8b2d-bebaada781a6 req-acd0caa0-5be8-4aca-848e-8297ec02f99d service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:57.050788 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-c9d88ff2-a456-4e42-8b2d-bebaada781a6 req-acd0caa0-5be8-4aca-848e-8297ec02f99d service nova] Creating event network-vif-deleted:d14efac8-b33a-4eb0-b610-32a9bf41b972 for instance 333fb179-0416-4534-95d0-4d9f3a9478f0 on hv-cinder-81618 Nov 08 16:14:57.055971 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-983fc54a-776c-4226-bb69-27fdde3f1e9f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.144091 Nov 08 16:14:57.056529 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-c9d88ff2-a456-4e42-8b2d-bebaada781a6 req-acd0caa0-5be8-4aca-848e-8297ec02f99d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033795 Nov 08 16:14:57.057127 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 382/761] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:56 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:14:57.057654 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 380/762] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:14:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:14:57.153755 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d92c91b1-52be-4fa3-9a00-3b7d732beff7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:57.155329 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d92c91b1-52be-4fa3-9a00-3b7d732beff7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:57.164822 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0a5cc2ba-b912-4c41-9a19-b40e4a6d6c63 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:57.166333 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0a5cc2ba-b912-4c41-9a19-b40e4a6d6c63 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:57.178673 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0a5cc2ba-b912-4c41-9a19-b40e4a6d6c63 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:57.179625 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0a5cc2ba-b912-4c41-9a19-b40e4a6d6c63 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:57.180761 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0a5cc2ba-b912-4c41-9a19-b40e4a6d6c63 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:57.181458 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0a5cc2ba-b912-4c41-9a19-b40e4a6d6c63 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:57.189791 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d92c91b1-52be-4fa3-9a00-3b7d732beff7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:57.190310 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d92c91b1-52be-4fa3-9a00-3b7d732beff7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:57.191147 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d92c91b1-52be-4fa3-9a00-3b7d732beff7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:57.191591 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d92c91b1-52be-4fa3-9a00-3b7d732beff7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:57.263892 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d92c91b1-52be-4fa3-9a00-3b7d732beff7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:57.264623 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d92c91b1-52be-4fa3-9a00-3b7d732beff7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:57.265269 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.objects.instance [None req-d92c91b1-52be-4fa3-9a00-3b7d732beff7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lazy-loading 'fault' on Instance uuid 333fb179-0416-4534-95d0-4d9f3a9478f0 {{(pid=115524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:14:57.375718 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-d92c91b1-52be-4fa3-9a00-3b7d732beff7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:57.382405 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d92c91b1-52be-4fa3-9a00-3b7d732beff7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 200 len: 1307 microversion: 2.1 time: 0.233623 Nov 08 16:14:57.383515 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 383/763] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:57 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 1307 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:57.398412 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0a5cc2ba-b912-4c41-9a19-b40e4a6d6c63 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:57.408663 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0a5cc2ba-b912-4c41-9a19-b40e4a6d6c63 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1560 microversion: 2.1 time: 0.248510 Nov 08 16:14:57.420517 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 381/764] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:57 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1560 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:14:57.491886 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ad3d7ccf-cb51-4243-92f6-605d0748e2bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:57.492963 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ad3d7ccf-cb51-4243-92f6-605d0748e2bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:57.500772 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad3d7ccf-cb51-4243-92f6-605d0748e2bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:57.501486 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad3d7ccf-cb51-4243-92f6-605d0748e2bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:57.502666 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad3d7ccf-cb51-4243-92f6-605d0748e2bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:57.503416 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad3d7ccf-cb51-4243-92f6-605d0748e2bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:57.611252 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.objects.instance [None req-ad3d7ccf-cb51-4243-92f6-605d0748e2bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lazy-loading 'services' on Instance uuid 44f7e3a8-0064-42ad-9e41-03a1ba050703 {{(pid=115524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:14:57.697002 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ad3d7ccf-cb51-4243-92f6-605d0748e2bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "DELETE /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/os-volume_attachments/56d2fe1f-b380-431c-8242-f9db69bda9ac" status: 202 len: 0 microversion: 2.1 time: 0.209488 Nov 08 16:14:57.698197 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 384/765] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Nov 8 16:14:57 2021] DELETE /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/os-volume_attachments/56d2fe1f-b380-431c-8242-f9db69bda9ac => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:14:57.706820 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-466de2ef-deed-4544-9bed-f8dcd4408cd0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:57.709023 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-466de2ef-deed-4544-9bed-f8dcd4408cd0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:57.714846 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-466de2ef-deed-4544-9bed-f8dcd4408cd0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:57.715312 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-466de2ef-deed-4544-9bed-f8dcd4408cd0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:57.716116 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-466de2ef-deed-4544-9bed-f8dcd4408cd0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:57.716609 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-466de2ef-deed-4544-9bed-f8dcd4408cd0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:57.755761 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-466de2ef-deed-4544-9bed-f8dcd4408cd0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053174 Nov 08 16:14:57.760535 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 382/766] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:14:57 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:14:58.035222 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5c00b7f3-eff3-4f45-bd07-10f755579f35 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:58.037785 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5c00b7f3-eff3-4f45-bd07-10f755579f35 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:58.045003 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5c00b7f3-eff3-4f45-bd07-10f755579f35 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:58.045458 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5c00b7f3-eff3-4f45-bd07-10f755579f35 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:58.046273 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5c00b7f3-eff3-4f45-bd07-10f755579f35 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:58.046918 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5c00b7f3-eff3-4f45-bd07-10f755579f35 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:58.068717 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d5d23ed8-7cce-4e9e-ac61-c5b34f47000f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:58.070407 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d5d23ed8-7cce-4e9e-ac61-c5b34f47000f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:58.077261 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5d23ed8-7cce-4e9e-ac61-c5b34f47000f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:58.077863 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5d23ed8-7cce-4e9e-ac61-c5b34f47000f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:58.085330 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5d23ed8-7cce-4e9e-ac61-c5b34f47000f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:58.086448 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5d23ed8-7cce-4e9e-ac61-c5b34f47000f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:58.167526 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5c00b7f3-eff3-4f45-bd07-10f755579f35 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.137925 Nov 08 16:14:58.168356 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 385/767] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:58 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:14:58.173493 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d5d23ed8-7cce-4e9e-ac61-c5b34f47000f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.109467 Nov 08 16:14:58.174500 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 383/768] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:58 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:14:58.400880 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2ced2ef9-0c45-4d17-a3e5-34764ae9b14d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:58.402107 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2ced2ef9-0c45-4d17-a3e5-34764ae9b14d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: 333fb179-0416-4534-95d0-4d9f3a9478f0] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:58.411355 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2ced2ef9-0c45-4d17-a3e5-34764ae9b14d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:58.411820 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2ced2ef9-0c45-4d17-a3e5-34764ae9b14d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:58.412608 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2ced2ef9-0c45-4d17-a3e5-34764ae9b14d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:58.413069 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2ced2ef9-0c45-4d17-a3e5-34764ae9b14d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:58.430124 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-2ced2ef9-0c45-4d17-a3e5-34764ae9b14d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] HTTP exception thrown: Instance 333fb179-0416-4534-95d0-4d9f3a9478f0 could not be found. Nov 08 16:14:58.430738 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2ced2ef9-0c45-4d17-a3e5-34764ae9b14d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Returning 404 to user: Instance 333fb179-0416-4534-95d0-4d9f3a9478f0 could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:14:58.433169 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2ced2ef9-0c45-4d17-a3e5-34764ae9b14d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0" status: 404 len: 111 microversion: 2.1 time: 0.035337 Nov 08 16:14:58.433169 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 386/769] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:58 2021] GET /compute/v2.1/servers/333fb179-0416-4534-95d0-4d9f3a9478f0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:14:58.786689 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a86d601b-e2d5-403b-9538-6fa4f64f4570 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:58.787716 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a86d601b-e2d5-403b-9538-6fa4f64f4570 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:58.795429 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a86d601b-e2d5-403b-9538-6fa4f64f4570 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:58.796326 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a86d601b-e2d5-403b-9538-6fa4f64f4570 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:58.798055 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a86d601b-e2d5-403b-9538-6fa4f64f4570 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:58.798741 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a86d601b-e2d5-403b-9538-6fa4f64f4570 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:58.836536 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a86d601b-e2d5-403b-9538-6fa4f64f4570 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054610 Nov 08 16:14:58.837121 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 384/770] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:14:58 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:14:59.180757 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0d9d58f3-a69a-4dbd-989b-7fa560bdaa6a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:59.182094 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0d9d58f3-a69a-4dbd-989b-7fa560bdaa6a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:59.188702 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8de2246a-fb6c-4c33-9369-2b4f5ec2caec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:14:59.190671 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8de2246a-fb6c-4c33-9369-2b4f5ec2caec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:59.192942 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0d9d58f3-a69a-4dbd-989b-7fa560bdaa6a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:59.194145 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0d9d58f3-a69a-4dbd-989b-7fa560bdaa6a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:59.195154 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0d9d58f3-a69a-4dbd-989b-7fa560bdaa6a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:59.195748 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0d9d58f3-a69a-4dbd-989b-7fa560bdaa6a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:59.198482 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8de2246a-fb6c-4c33-9369-2b4f5ec2caec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:59.198993 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8de2246a-fb6c-4c33-9369-2b4f5ec2caec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:59.200420 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8de2246a-fb6c-4c33-9369-2b4f5ec2caec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:59.201141 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8de2246a-fb6c-4c33-9369-2b4f5ec2caec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:59.327582 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0d9d58f3-a69a-4dbd-989b-7fa560bdaa6a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.151064 Nov 08 16:14:59.328591 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 387/771] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:14:59 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:14:59.339223 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8de2246a-fb6c-4c33-9369-2b4f5ec2caec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.155395 Nov 08 16:14:59.342013 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 385/772] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:14:59 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:14:59.588860 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0734529c-18e8-44c2-8b5a-1fce8ef29f7e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:59.589504 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0734529c-18e8-44c2-8b5a-1fce8ef29f7e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:59.597423 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0734529c-18e8-44c2-8b5a-1fce8ef29f7e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:59.598137 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0734529c-18e8-44c2-8b5a-1fce8ef29f7e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:59.598919 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0734529c-18e8-44c2-8b5a-1fce8ef29f7e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:59.599356 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0734529c-18e8-44c2-8b5a-1fce8ef29f7e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:59.625299 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0734529c-18e8-44c2-8b5a-1fce8ef29f7e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Going to try to terminate instance {{(pid=115524) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:14:59.704607 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0734529c-18e8-44c2-8b5a-1fce8ef29f7e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "DELETE /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 204 len: 0 microversion: 2.1 time: 0.119407 Nov 08 16:14:59.708331 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 388/773] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:14:59 2021] DELETE /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:14:59.728958 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5e631ad0-f251-4b6d-acc8-cebdd2c54749 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:59.729847 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5e631ad0-f251-4b6d-acc8-cebdd2c54749 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:59.737645 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5e631ad0-f251-4b6d-acc8-cebdd2c54749 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:59.739309 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5e631ad0-f251-4b6d-acc8-cebdd2c54749 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:59.740157 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5e631ad0-f251-4b6d-acc8-cebdd2c54749 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:59.740594 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5e631ad0-f251-4b6d-acc8-cebdd2c54749 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:59.848359 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d688b442-1fcb-4c19-8b15-4e21633ef9e2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:14:59.849632 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d688b442-1fcb-4c19-8b15-4e21633ef9e2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:14:59.856092 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d688b442-1fcb-4c19-8b15-4e21633ef9e2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:59.856774 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d688b442-1fcb-4c19-8b15-4e21633ef9e2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:59.857554 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d688b442-1fcb-4c19-8b15-4e21633ef9e2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:14:59.858015 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d688b442-1fcb-4c19-8b15-4e21633ef9e2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:14:59.888992 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d688b442-1fcb-4c19-8b15-4e21633ef9e2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044661 Nov 08 16:14:59.890384 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 389/774] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:14:59 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 08 16:14:59.892602 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-5e631ad0-f251-4b6d-acc8-cebdd2c54749 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:14:59.901138 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5e631ad0-f251-4b6d-acc8-cebdd2c54749 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1514 microversion: 2.1 time: 0.191317 Nov 08 16:14:59.901994 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 386/775] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:14:59 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:00.339619 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d2ab28fb-d749-4969-9521-3c67e83a1472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:00.340523 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d2ab28fb-d749-4969-9521-3c67e83a1472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:00.347541 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d2ab28fb-d749-4969-9521-3c67e83a1472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:00.347986 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d2ab28fb-d749-4969-9521-3c67e83a1472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:00.348762 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d2ab28fb-d749-4969-9521-3c67e83a1472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:00.349196 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d2ab28fb-d749-4969-9521-3c67e83a1472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:00.351917 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-da9dac7a-9a8f-47c4-8076-4d0a1b660356 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:00.352928 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-da9dac7a-9a8f-47c4-8076-4d0a1b660356 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:00.359145 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-da9dac7a-9a8f-47c4-8076-4d0a1b660356 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:00.359591 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-da9dac7a-9a8f-47c4-8076-4d0a1b660356 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:00.360398 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-da9dac7a-9a8f-47c4-8076-4d0a1b660356 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:00.360829 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-da9dac7a-9a8f-47c4-8076-4d0a1b660356 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:00.431039 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d2ab28fb-d749-4969-9521-3c67e83a1472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.094902 Nov 08 16:15:00.431875 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 390/776] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:00 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:00.441451 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-da9dac7a-9a8f-47c4-8076-4d0a1b660356 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.093037 Nov 08 16:15:00.442327 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 387/777] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:00 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:15:00.827742 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9f0cf123-67a0-4fdf-ad50-b5d5b437c271 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:00.828285 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9f0cf123-67a0-4fdf-ad50-b5d5b437c271 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:00.835507 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9f0cf123-67a0-4fdf-ad50-b5d5b437c271 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:00.835946 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9f0cf123-67a0-4fdf-ad50-b5d5b437c271 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:00.836705 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9f0cf123-67a0-4fdf-ad50-b5d5b437c271 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:00.837134 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9f0cf123-67a0-4fdf-ad50-b5d5b437c271 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:00.914961 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.objects.instance [None req-9f0cf123-67a0-4fdf-ad50-b5d5b437c271 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lazy-loading 'services' on Instance uuid e41a90ba-f4f1-472e-9883-150d31bcc777 {{(pid=115524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:15:00.919082 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-eb8a0460-d3c2-4073-b174-bdf831ecd5a3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:00.920379 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-eb8a0460-d3c2-4073-b174-bdf831ecd5a3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:00.927263 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eb8a0460-d3c2-4073-b174-bdf831ecd5a3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:00.927756 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eb8a0460-d3c2-4073-b174-bdf831ecd5a3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:00.928524 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eb8a0460-d3c2-4073-b174-bdf831ecd5a3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:00.929056 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eb8a0460-d3c2-4073-b174-bdf831ecd5a3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:00.991530 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9f0cf123-67a0-4fdf-ad50-b5d5b437c271 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777/os-volume_attachments/d1d1e0de-bbe7-4f45-9804-6f4726fbdadc" status: 202 len: 0 microversion: 2.1 time: 0.167593 Nov 08 16:15:00.992119 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 391/778] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Nov 8 16:15:00 2021] DELETE /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777/os-volume_attachments/d1d1e0de-bbe7-4f45-9804-6f4726fbdadc => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:15:01.075913 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-eb8a0460-d3c2-4073-b174-bdf831ecd5a3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:01.088621 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-eb8a0460-d3c2-4073-b174-bdf831ecd5a3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1514 microversion: 2.1 time: 0.173860 Nov 08 16:15:01.089367 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 388/779] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:00 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:15:01.443035 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-929cf611-6c66-4981-8c7e-bc1cf049eb8c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:01.444039 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-929cf611-6c66-4981-8c7e-bc1cf049eb8c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:01.450910 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-929cf611-6c66-4981-8c7e-bc1cf049eb8c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:01.451359 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-929cf611-6c66-4981-8c7e-bc1cf049eb8c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:01.452137 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-929cf611-6c66-4981-8c7e-bc1cf049eb8c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:01.452454 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-cd93aed8-d5e5-4431-9b3b-4a4f2e730e61 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:01.452925 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-929cf611-6c66-4981-8c7e-bc1cf049eb8c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:01.453359 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-cd93aed8-d5e5-4431-9b3b-4a4f2e730e61 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:01.462513 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cd93aed8-d5e5-4431-9b3b-4a4f2e730e61 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:01.462954 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cd93aed8-d5e5-4431-9b3b-4a4f2e730e61 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:01.463763 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cd93aed8-d5e5-4431-9b3b-4a4f2e730e61 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:01.464325 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cd93aed8-d5e5-4431-9b3b-4a4f2e730e61 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:01.621877 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-cd93aed8-d5e5-4431-9b3b-4a4f2e730e61 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.172919 Nov 08 16:15:01.622785 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 389/780] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:01 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:15:01.626739 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-929cf611-6c66-4981-8c7e-bc1cf049eb8c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.187502 Nov 08 16:15:01.633295 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 392/781] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:01 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:02.114031 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b4b5a699-3e48-4c83-98e4-2171ce574789 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:02.114031 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b4b5a699-3e48-4c83-98e4-2171ce574789 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:02.117894 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b4b5a699-3e48-4c83-98e4-2171ce574789 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:02.118471 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b4b5a699-3e48-4c83-98e4-2171ce574789 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:02.119355 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b4b5a699-3e48-4c83-98e4-2171ce574789 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:02.119948 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b4b5a699-3e48-4c83-98e4-2171ce574789 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:02.122179 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b3a8bf01-8cca-42d9-adfd-a5096fddbdaa tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:02.122932 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b3a8bf01-8cca-42d9-adfd-a5096fddbdaa tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:02.131265 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b3a8bf01-8cca-42d9-adfd-a5096fddbdaa tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:02.131943 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b3a8bf01-8cca-42d9-adfd-a5096fddbdaa tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:02.132911 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b3a8bf01-8cca-42d9-adfd-a5096fddbdaa tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:02.133507 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b3a8bf01-8cca-42d9-adfd-a5096fddbdaa tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:02.171314 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b3a8bf01-8cca-42d9-adfd-a5096fddbdaa tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Going to try to terminate instance {{(pid=115524) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:15:02.256617 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b3a8bf01-8cca-42d9-adfd-a5096fddbdaa tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 204 len: 0 microversion: 2.1 time: 0.139659 Nov 08 16:15:02.260444 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 393/782] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:15:02 2021] DELETE /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:15:02.262990 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-255afce8-9fd4-483d-b872-4050475fd848 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:02.263652 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-255afce8-9fd4-483d-b872-4050475fd848 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:02.270174 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-255afce8-9fd4-483d-b872-4050475fd848 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:02.270613 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-255afce8-9fd4-483d-b872-4050475fd848 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:02.271385 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-255afce8-9fd4-483d-b872-4050475fd848 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:02.271813 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-255afce8-9fd4-483d-b872-4050475fd848 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:02.297207 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-255afce8-9fd4-483d-b872-4050475fd848 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Going to try to terminate instance {{(pid=115524) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:15:02.363354 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b4b5a699-3e48-4c83-98e4-2171ce574789 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7bdbcc6f4845d590103ec01173c2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e9715f7424ff5b3b252f354adafe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:02.371688 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-255afce8-9fd4-483d-b872-4050475fd848 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "DELETE /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 204 len: 0 microversion: 2.1 time: 0.112883 Nov 08 16:15:02.372597 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 394/783] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:15:02 2021] DELETE /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:15:02.374437 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b4b5a699-3e48-4c83-98e4-2171ce574789 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 200 len: 1514 microversion: 2.1 time: 0.272150 Nov 08 16:15:02.375218 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 390/784] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:02 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 1514 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:02.381610 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d6880778-dd11-4469-8639-9a10b35c5f3b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:02.382040 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9928bd6c-6a98-4417-9754-f9bde390ac36 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:02.382632 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d6880778-dd11-4469-8639-9a10b35c5f3b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:02.382756 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9928bd6c-6a98-4417-9754-f9bde390ac36 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:02.390543 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d6880778-dd11-4469-8639-9a10b35c5f3b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:02.391250 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9928bd6c-6a98-4417-9754-f9bde390ac36 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:02.391719 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9928bd6c-6a98-4417-9754-f9bde390ac36 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:02.392111 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d6880778-dd11-4469-8639-9a10b35c5f3b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:02.392865 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9928bd6c-6a98-4417-9754-f9bde390ac36 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:02.393221 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d6880778-dd11-4469-8639-9a10b35c5f3b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:02.393393 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9928bd6c-6a98-4417-9754-f9bde390ac36 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:02.393770 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d6880778-dd11-4469-8639-9a10b35c5f3b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:02.702945 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d6880778-dd11-4469-8639-9a10b35c5f3b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:02.710019 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d6880778-dd11-4469-8639-9a10b35c5f3b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1508 microversion: 2.1 time: 0.333036 Nov 08 16:15:02.710578 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 391/785] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:02 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1508 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:02.714862 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5052bd19-c291-4cd2-b9d5-8ff70ba3f526 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:02.715808 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5052bd19-c291-4cd2-b9d5-8ff70ba3f526 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:02.720499 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-9928bd6c-6a98-4417-9754-f9bde390ac36 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:02.722890 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5052bd19-c291-4cd2-b9d5-8ff70ba3f526 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:02.723501 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5052bd19-c291-4cd2-b9d5-8ff70ba3f526 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:02.724238 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5052bd19-c291-4cd2-b9d5-8ff70ba3f526 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:02.724662 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5052bd19-c291-4cd2-b9d5-8ff70ba3f526 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:02.731422 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9928bd6c-6a98-4417-9754-f9bde390ac36 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1513 microversion: 2.1 time: 0.354366 Nov 08 16:15:02.741683 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 395/786] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:02 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1513 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:02.741683 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-fda2246a-d32f-4e4a-896d-347afd8b393b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:02.741683 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-fda2246a-d32f-4e4a-896d-347afd8b393b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:02.749017 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fda2246a-d32f-4e4a-896d-347afd8b393b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:02.749591 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fda2246a-d32f-4e4a-896d-347afd8b393b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:02.750509 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fda2246a-d32f-4e4a-896d-347afd8b393b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:02.751071 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fda2246a-d32f-4e4a-896d-347afd8b393b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:02.823811 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5052bd19-c291-4cd2-b9d5-8ff70ba3f526 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.111916 Nov 08 16:15:02.827651 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 392/787] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:02 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:15:02.829210 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-7b9bf191-8ef1-4d69-8332-435555e1bfd4 req-63179285-515f-4b21-bc82-24c08544aa59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa35d29-db7d-4fab-a001-7db0d508d70a", "name": "network-vif-deleted", "tag": "4020a644-ef2e-4dd8-931a-cfccef4e7b15"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:02.830752 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:15:02.830752 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:15:02.839535 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-7b9bf191-8ef1-4d69-8332-435555e1bfd4 req-63179285-515f-4b21-bc82-24c08544aa59 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:02.839994 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-7b9bf191-8ef1-4d69-8332-435555e1bfd4 req-63179285-515f-4b21-bc82-24c08544aa59 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:02.851122 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-7b9bf191-8ef1-4d69-8332-435555e1bfd4 req-63179285-515f-4b21-bc82-24c08544aa59 service nova] Creating event network-vif-deleted:4020a644-ef2e-4dd8-931a-cfccef4e7b15 for instance dfa35d29-db7d-4fab-a001-7db0d508d70a on hv-cinder-81618 Nov 08 16:15:02.856910 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-7b9bf191-8ef1-4d69-8332-435555e1bfd4 req-63179285-515f-4b21-bc82-24c08544aa59 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031248 Nov 08 16:15:02.857482 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 393/788] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:15:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:15:02.857983 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-fda2246a-d32f-4e4a-896d-347afd8b393b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.124335 Nov 08 16:15:02.858801 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 396/789] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:02 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:03.392589 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b3d59ac9-a481-4fe0-bd51-031e4bfb7c28 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:03.393300 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b3d59ac9-a481-4fe0-bd51-031e4bfb7c28 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] [instance: dfa35d29-db7d-4fab-a001-7db0d508d70a] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:03.399866 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b3d59ac9-a481-4fe0-bd51-031e4bfb7c28 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:03.400417 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b3d59ac9-a481-4fe0-bd51-031e4bfb7c28 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:03.401050 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b3d59ac9-a481-4fe0-bd51-031e4bfb7c28 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:03.401513 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b3d59ac9-a481-4fe0-bd51-031e4bfb7c28 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:03.415524 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-b3d59ac9-a481-4fe0-bd51-031e4bfb7c28 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] HTTP exception thrown: Instance dfa35d29-db7d-4fab-a001-7db0d508d70a could not be found. Nov 08 16:15:03.416107 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b3d59ac9-a481-4fe0-bd51-031e4bfb7c28 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Returning 404 to user: Instance dfa35d29-db7d-4fab-a001-7db0d508d70a could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:15:03.416947 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b3d59ac9-a481-4fe0-bd51-031e4bfb7c28 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a" status: 404 len: 111 microversion: 2.1 time: 0.028482 Nov 08 16:15:03.417495 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 394/790] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:03 2021] GET /compute/v2.1/servers/dfa35d29-db7d-4fab-a001-7db0d508d70a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:15:03.728622 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3c6ff9e2-9680-4303-9a7c-9c3186b58175 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:03.730103 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3c6ff9e2-9680-4303-9a7c-9c3186b58175 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:03.740728 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3c6ff9e2-9680-4303-9a7c-9c3186b58175 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:03.741293 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3c6ff9e2-9680-4303-9a7c-9c3186b58175 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:03.743735 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3c6ff9e2-9680-4303-9a7c-9c3186b58175 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:03.744257 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3c6ff9e2-9680-4303-9a7c-9c3186b58175 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:03.748438 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-976d417b-5fc2-40bd-b1f3-a4fde01b98b8 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:03.749039 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-976d417b-5fc2-40bd-b1f3-a4fde01b98b8 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:03.759629 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-976d417b-5fc2-40bd-b1f3-a4fde01b98b8 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:03.760185 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-976d417b-5fc2-40bd-b1f3-a4fde01b98b8 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:03.761183 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-976d417b-5fc2-40bd-b1f3-a4fde01b98b8 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:03.761628 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-976d417b-5fc2-40bd-b1f3-a4fde01b98b8 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:03.960965 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-3c6ff9e2-9680-4303-9a7c-9c3186b58175 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:03.968665 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3c6ff9e2-9680-4303-9a7c-9c3186b58175 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1508 microversion: 2.1 time: 0.244309 Nov 08 16:15:03.970940 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 397/791] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:03 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:03.976640 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3d523d21-42cf-48b9-b078-f291440edd17 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:03.977570 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3d523d21-42cf-48b9-b078-f291440edd17 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:03.984670 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3d523d21-42cf-48b9-b078-f291440edd17 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:03.985128 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3d523d21-42cf-48b9-b078-f291440edd17 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:03.986042 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3d523d21-42cf-48b9-b078-f291440edd17 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:03.986482 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3d523d21-42cf-48b9-b078-f291440edd17 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:04.004804 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-976d417b-5fc2-40bd-b1f3-a4fde01b98b8 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:04.015564 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-976d417b-5fc2-40bd-b1f3-a4fde01b98b8 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1513 microversion: 2.1 time: 0.270988 Nov 08 16:15:04.026704 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 395/792] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:03 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1513 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:15:04.031625 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-22933a99-cd46-490c-a928-c64582b1c5f1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:04.032760 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-22933a99-cd46-490c-a928-c64582b1c5f1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:04.040622 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-22933a99-cd46-490c-a928-c64582b1c5f1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:04.041073 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-22933a99-cd46-490c-a928-c64582b1c5f1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:04.041901 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-22933a99-cd46-490c-a928-c64582b1c5f1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:04.042343 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-22933a99-cd46-490c-a928-c64582b1c5f1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:04.056075 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3d523d21-42cf-48b9-b078-f291440edd17 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.082993 Nov 08 16:15:04.057052 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 398/793] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:03 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:15:04.123250 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-22933a99-cd46-490c-a928-c64582b1c5f1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.094961 Nov 08 16:15:04.124001 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 396/794] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:04 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:04.988661 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-118fbc3a-e28d-46c6-aaf5-3989a9727153 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:04.990088 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-118fbc3a-e28d-46c6-aaf5-3989a9727153 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:04.997627 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-118fbc3a-e28d-46c6-aaf5-3989a9727153 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:04.998425 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-118fbc3a-e28d-46c6-aaf5-3989a9727153 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:04.999587 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-118fbc3a-e28d-46c6-aaf5-3989a9727153 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:05.000247 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-118fbc3a-e28d-46c6-aaf5-3989a9727153 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:05.035310 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-791df445-a76a-4304-9336-2a1280a5ad8a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:05.036081 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-791df445-a76a-4304-9336-2a1280a5ad8a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:05.044965 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-791df445-a76a-4304-9336-2a1280a5ad8a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:05.045407 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-791df445-a76a-4304-9336-2a1280a5ad8a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:05.046212 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-791df445-a76a-4304-9336-2a1280a5ad8a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:05.046852 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-791df445-a76a-4304-9336-2a1280a5ad8a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:05.280427 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-118fbc3a-e28d-46c6-aaf5-3989a9727153 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:05.289882 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-118fbc3a-e28d-46c6-aaf5-3989a9727153 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1508 microversion: 2.1 time: 0.305788 Nov 08 16:15:05.290835 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 399/795] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:04 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1508 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:05.296132 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bf630401-5314-4841-88d1-da82f07f6a52 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:05.297049 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-bf630401-5314-4841-88d1-da82f07f6a52 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:05.310120 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bf630401-5314-4841-88d1-da82f07f6a52 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:05.311140 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bf630401-5314-4841-88d1-da82f07f6a52 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:05.314362 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bf630401-5314-4841-88d1-da82f07f6a52 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:05.316068 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bf630401-5314-4841-88d1-da82f07f6a52 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:05.385360 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-791df445-a76a-4304-9336-2a1280a5ad8a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:05.393187 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-791df445-a76a-4304-9336-2a1280a5ad8a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 200 len: 1513 microversion: 2.1 time: 0.362883 Nov 08 16:15:05.393756 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 397/796] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:05 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 1513 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:15:05.411371 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-afd06550-2a89-4b59-a89e-66a59c6e80d0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:05.412279 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-afd06550-2a89-4b59-a89e-66a59c6e80d0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:05.423279 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-afd06550-2a89-4b59-a89e-66a59c6e80d0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:05.424815 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-afd06550-2a89-4b59-a89e-66a59c6e80d0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:05.427060 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-afd06550-2a89-4b59-a89e-66a59c6e80d0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:05.428469 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-afd06550-2a89-4b59-a89e-66a59c6e80d0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:05.430793 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bf630401-5314-4841-88d1-da82f07f6a52 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.138672 Nov 08 16:15:05.434420 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 400/797] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:05 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:15:05.448744 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-32c88ba8-5e3c-4157-a51c-9961fa0185a6 req-2e510524-5be3-4d0b-af37-9beff9af38c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e41a90ba-f4f1-472e-9883-150d31bcc777", "name": "network-vif-deleted", "tag": "69152346-0cf4-4b0a-9db9-f1bddb32dc4b"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:05.458880 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:15:05.458880 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:15:05.482670 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-32c88ba8-5e3c-4157-a51c-9961fa0185a6 req-2e510524-5be3-4d0b-af37-9beff9af38c2 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:05.483195 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-32c88ba8-5e3c-4157-a51c-9961fa0185a6 req-2e510524-5be3-4d0b-af37-9beff9af38c2 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:05.494805 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-32c88ba8-5e3c-4157-a51c-9961fa0185a6 req-2e510524-5be3-4d0b-af37-9beff9af38c2 service nova] Creating event network-vif-deleted:69152346-0cf4-4b0a-9db9-f1bddb32dc4b for instance e41a90ba-f4f1-472e-9883-150d31bcc777 on hv-cinder-81618 Nov 08 16:15:05.499817 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-32c88ba8-5e3c-4157-a51c-9961fa0185a6 req-2e510524-5be3-4d0b-af37-9beff9af38c2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063932 Nov 08 16:15:05.500657 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 401/798] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:15:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:15:05.595127 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-afd06550-2a89-4b59-a89e-66a59c6e80d0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.187699 Nov 08 16:15:05.597484 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 398/799] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:05 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:06.308835 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-79e9d87e-4e37-4cf7-b034-500dee5d25de tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:06.309598 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-79e9d87e-4e37-4cf7-b034-500dee5d25de tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:06.320790 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-79e9d87e-4e37-4cf7-b034-500dee5d25de tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:06.321624 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-79e9d87e-4e37-4cf7-b034-500dee5d25de tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:06.322800 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-79e9d87e-4e37-4cf7-b034-500dee5d25de tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:06.323238 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-79e9d87e-4e37-4cf7-b034-500dee5d25de tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:06.410759 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b3c34527-ac81-4373-bf40-0b6824fbe746 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:06.411624 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b3c34527-ac81-4373-bf40-0b6824fbe746 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: e41a90ba-f4f1-472e-9883-150d31bcc777] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:06.418671 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b3c34527-ac81-4373-bf40-0b6824fbe746 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:06.419202 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b3c34527-ac81-4373-bf40-0b6824fbe746 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:06.420080 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b3c34527-ac81-4373-bf40-0b6824fbe746 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:06.420391 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b3c34527-ac81-4373-bf40-0b6824fbe746 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:06.438106 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-b3c34527-ac81-4373-bf40-0b6824fbe746 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] HTTP exception thrown: Instance e41a90ba-f4f1-472e-9883-150d31bcc777 could not be found. Nov 08 16:15:06.438702 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b3c34527-ac81-4373-bf40-0b6824fbe746 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Returning 404 to user: Instance e41a90ba-f4f1-472e-9883-150d31bcc777 could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:15:06.440250 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b3c34527-ac81-4373-bf40-0b6824fbe746 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777" status: 404 len: 111 microversion: 2.1 time: 0.033199 Nov 08 16:15:06.441967 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 399/800] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:06 2021] GET /compute/v2.1/servers/e41a90ba-f4f1-472e-9883-150d31bcc777 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 08 16:15:06.447123 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-81b35e44-68e8-4ebd-b9c2-bebcee3b2227 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:06.448644 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-81b35e44-68e8-4ebd-b9c2-bebcee3b2227 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:06.463192 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-81b35e44-68e8-4ebd-b9c2-bebcee3b2227 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:06.463804 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-81b35e44-68e8-4ebd-b9c2-bebcee3b2227 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:06.464835 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-81b35e44-68e8-4ebd-b9c2-bebcee3b2227 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:06.465267 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-81b35e44-68e8-4ebd-b9c2-bebcee3b2227 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:06.567313 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-81b35e44-68e8-4ebd-b9c2-bebcee3b2227 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.123892 Nov 08 16:15:06.575050 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 400/801] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:06 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:15:06.592320 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-79e9d87e-4e37-4cf7-b034-500dee5d25de tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:06.600132 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-79e9d87e-4e37-4cf7-b034-500dee5d25de tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1508 microversion: 2.1 time: 0.296300 Nov 08 16:15:06.603077 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 402/802] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:06 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1508 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:06.611571 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d59a10a3-a63f-4168-ac91-75580ac1dc9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:06.613637 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d59a10a3-a63f-4168-ac91-75580ac1dc9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:06.626755 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d59a10a3-a63f-4168-ac91-75580ac1dc9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:06.628021 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d59a10a3-a63f-4168-ac91-75580ac1dc9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:06.629130 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d59a10a3-a63f-4168-ac91-75580ac1dc9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:06.630060 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d59a10a3-a63f-4168-ac91-75580ac1dc9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:06.737803 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d59a10a3-a63f-4168-ac91-75580ac1dc9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.131523 Nov 08 16:15:06.738649 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 401/803] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:06 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:07.519456 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-dc8765e0-9c14-46f9-aa73-66f5ee0739cd req-0b43c3b0-6d7d-45e9-adad-9ef2c4b3d938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a953f3-d586-4495-b2d1-3c6e6cd89a52", "name": "network-vif-deleted", "tag": "3e7ad14a-6975-4075-ac69-3a504ad24341"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:07.521867 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:15:07.521867 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:15:07.529719 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-dc8765e0-9c14-46f9-aa73-66f5ee0739cd req-0b43c3b0-6d7d-45e9-adad-9ef2c4b3d938 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:07.530266 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-dc8765e0-9c14-46f9-aa73-66f5ee0739cd req-0b43c3b0-6d7d-45e9-adad-9ef2c4b3d938 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:07.541851 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-dc8765e0-9c14-46f9-aa73-66f5ee0739cd req-0b43c3b0-6d7d-45e9-adad-9ef2c4b3d938 service nova] Creating event network-vif-deleted:3e7ad14a-6975-4075-ac69-3a504ad24341 for instance a3a953f3-d586-4495-b2d1-3c6e6cd89a52 on hv-cinder-81618 Nov 08 16:15:07.546710 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-dc8765e0-9c14-46f9-aa73-66f5ee0739cd req-0b43c3b0-6d7d-45e9-adad-9ef2c4b3d938 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032227 Nov 08 16:15:07.547379 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 403/804] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:15:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:15:07.579946 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-90ca3276-356d-4cb5-b132-31407f2886ac tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:07.581440 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-90ca3276-356d-4cb5-b132-31407f2886ac tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:07.588334 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-90ca3276-356d-4cb5-b132-31407f2886ac tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:07.588779 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-90ca3276-356d-4cb5-b132-31407f2886ac tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:07.589560 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-90ca3276-356d-4cb5-b132-31407f2886ac tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:07.590022 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-90ca3276-356d-4cb5-b132-31407f2886ac tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:07.620006 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1bd7dbbe-02bf-4ff8-89b1-11e8bbdc1457 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:07.621054 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1bd7dbbe-02bf-4ff8-89b1-11e8bbdc1457 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:07.628138 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1bd7dbbe-02bf-4ff8-89b1-11e8bbdc1457 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:07.628582 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1bd7dbbe-02bf-4ff8-89b1-11e8bbdc1457 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:07.629997 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1bd7dbbe-02bf-4ff8-89b1-11e8bbdc1457 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:07.630617 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1bd7dbbe-02bf-4ff8-89b1-11e8bbdc1457 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:07.665001 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1bd7dbbe-02bf-4ff8-89b1-11e8bbdc1457 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:07.665493 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1bd7dbbe-02bf-4ff8-89b1-11e8bbdc1457 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:07.665964 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.objects.instance [None req-1bd7dbbe-02bf-4ff8-89b1-11e8bbdc1457 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lazy-loading 'fault' on Instance uuid a3a953f3-d586-4495-b2d1-3c6e6cd89a52 {{(pid=115524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:15:07.711055 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1bd7dbbe-02bf-4ff8-89b1-11e8bbdc1457 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:07.719227 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1bd7dbbe-02bf-4ff8-89b1-11e8bbdc1457 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1312 microversion: 2.1 time: 0.104712 Nov 08 16:15:07.720485 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 404/805] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:07 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:07.750105 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-464ff0dd-f1af-4369-9dd2-d698061f718b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:07.751018 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-464ff0dd-f1af-4369-9dd2-d698061f718b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:07.757023 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-464ff0dd-f1af-4369-9dd2-d698061f718b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:07.757463 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-464ff0dd-f1af-4369-9dd2-d698061f718b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:07.758452 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-464ff0dd-f1af-4369-9dd2-d698061f718b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:07.759012 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-464ff0dd-f1af-4369-9dd2-d698061f718b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:11.693518 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-464ff0dd-f1af-4369-9dd2-d698061f718b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 3.947150 Nov 08 16:15:11.694191 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 405/806] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:07 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 3949 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:11.699628 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-de689745-3c70-424c-bea9-38b9db7d9c69 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:11.700375 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-de689745-3c70-424c-bea9-38b9db7d9c69 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:11.701223 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-90ca3276-356d-4cb5-b132-31407f2886ac tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 4.125154 Nov 08 16:15:11.702268 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 402/807] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:07 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 4127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:15:11.708521 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-de689745-3c70-424c-bea9-38b9db7d9c69 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:11.708972 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-de689745-3c70-424c-bea9-38b9db7d9c69 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:11.709812 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-de689745-3c70-424c-bea9-38b9db7d9c69 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:11.710281 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-de689745-3c70-424c-bea9-38b9db7d9c69 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:11.742888 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-de689745-3c70-424c-bea9-38b9db7d9c69 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:11.743449 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-de689745-3c70-424c-bea9-38b9db7d9c69 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:11.743899 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.objects.instance [None req-de689745-3c70-424c-bea9-38b9db7d9c69 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lazy-loading 'fault' on Instance uuid a3a953f3-d586-4495-b2d1-3c6e6cd89a52 {{(pid=115524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:15:11.790319 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-de689745-3c70-424c-bea9-38b9db7d9c69 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:11.796955 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-de689745-3c70-424c-bea9-38b9db7d9c69 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 200 len: 1312 microversion: 2.1 time: 0.101609 Nov 08 16:15:11.797501 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 406/808] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:11 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:12.706493 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5ce92a71-1b68-43c2-ab8c-a08062870720 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:12.708116 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5ce92a71-1b68-43c2-ab8c-a08062870720 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:12.712468 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d959123d-963c-45ac-a816-bda9642871eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:12.713452 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d959123d-963c-45ac-a816-bda9642871eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:12.715122 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5ce92a71-1b68-43c2-ab8c-a08062870720 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:12.715570 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5ce92a71-1b68-43c2-ab8c-a08062870720 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:12.716375 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5ce92a71-1b68-43c2-ab8c-a08062870720 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:12.716788 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5ce92a71-1b68-43c2-ab8c-a08062870720 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:12.719911 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d959123d-963c-45ac-a816-bda9642871eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:12.720354 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d959123d-963c-45ac-a816-bda9642871eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:12.721154 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d959123d-963c-45ac-a816-bda9642871eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:12.721582 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d959123d-963c-45ac-a816-bda9642871eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:12.787014 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5ce92a71-1b68-43c2-ab8c-a08062870720 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.084757 Nov 08 16:15:12.787647 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 403/809] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:12 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:12.808099 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d959123d-963c-45ac-a816-bda9642871eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.099384 Nov 08 16:15:12.811915 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 407/810] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:12 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:15:12.813474 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5b5408f2-fe6f-44f5-a6fc-cd0c8c0fd23d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:12.814957 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5b5408f2-fe6f-44f5-a6fc-cd0c8c0fd23d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: a3a953f3-d586-4495-b2d1-3c6e6cd89a52] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:12.821752 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b5408f2-fe6f-44f5-a6fc-cd0c8c0fd23d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:12.822201 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b5408f2-fe6f-44f5-a6fc-cd0c8c0fd23d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:12.822975 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b5408f2-fe6f-44f5-a6fc-cd0c8c0fd23d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:12.823406 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b5408f2-fe6f-44f5-a6fc-cd0c8c0fd23d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:12.837386 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-5b5408f2-fe6f-44f5-a6fc-cd0c8c0fd23d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] HTTP exception thrown: Instance a3a953f3-d586-4495-b2d1-3c6e6cd89a52 could not be found. Nov 08 16:15:12.837990 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5b5408f2-fe6f-44f5-a6fc-cd0c8c0fd23d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Returning 404 to user: Instance a3a953f3-d586-4495-b2d1-3c6e6cd89a52 could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:15:12.838826 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5b5408f2-fe6f-44f5-a6fc-cd0c8c0fd23d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52" status: 404 len: 111 microversion: 2.1 time: 0.029161 Nov 08 16:15:12.839353 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 404/811] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:12 2021] GET /compute/v2.1/servers/a3a953f3-d586-4495-b2d1-3c6e6cd89a52 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 08 16:15:12.847537 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7078c27e-0b01-48bf-be20-dc07a8112575 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:12.848116 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7078c27e-0b01-48bf-be20-dc07a8112575 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:12.854969 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7078c27e-0b01-48bf-be20-dc07a8112575 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:12.855428 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7078c27e-0b01-48bf-be20-dc07a8112575 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:12.856199 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7078c27e-0b01-48bf-be20-dc07a8112575 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:12.856633 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7078c27e-0b01-48bf-be20-dc07a8112575 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:12.885996 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7078c27e-0b01-48bf-be20-dc07a8112575 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Going to try to terminate instance {{(pid=115524) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:15:12.970774 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7078c27e-0b01-48bf-be20-dc07a8112575 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "DELETE /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 204 len: 0 microversion: 2.1 time: 0.126716 Nov 08 16:15:12.971435 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 408/812] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:15:12 2021] DELETE /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:15:12.980020 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-226c1ddb-1e9d-4cec-9244-225aa6b9b203 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:12.980835 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-226c1ddb-1e9d-4cec-9244-225aa6b9b203 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:12.989476 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-226c1ddb-1e9d-4cec-9244-225aa6b9b203 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:12.990020 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-226c1ddb-1e9d-4cec-9244-225aa6b9b203 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:12.990942 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-226c1ddb-1e9d-4cec-9244-225aa6b9b203 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:12.991434 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-226c1ddb-1e9d-4cec-9244-225aa6b9b203 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:13.125619 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-226c1ddb-1e9d-4cec-9244-225aa6b9b203 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:13.133281 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-226c1ddb-1e9d-4cec-9244-225aa6b9b203 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.157332 Nov 08 16:15:13.133898 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 405/813] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:12 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:13.800606 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-67e40aee-0fc2-4269-8045-b36e46739948 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:13.801933 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-67e40aee-0fc2-4269-8045-b36e46739948 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:13.809335 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-67e40aee-0fc2-4269-8045-b36e46739948 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:13.810313 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-67e40aee-0fc2-4269-8045-b36e46739948 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:13.811426 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-67e40aee-0fc2-4269-8045-b36e46739948 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:13.812046 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-67e40aee-0fc2-4269-8045-b36e46739948 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:13.819915 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-eabc9856-844d-45da-bf20-4d7774bd86eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:13.821228 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-eabc9856-844d-45da-bf20-4d7774bd86eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:13.828581 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eabc9856-844d-45da-bf20-4d7774bd86eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:13.829141 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eabc9856-844d-45da-bf20-4d7774bd86eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:13.831102 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eabc9856-844d-45da-bf20-4d7774bd86eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:13.832020 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eabc9856-844d-45da-bf20-4d7774bd86eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:13.902712 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-67e40aee-0fc2-4269-8045-b36e46739948 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.107192 Nov 08 16:15:13.903355 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 409/814] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:13 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:15:13.917297 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-eabc9856-844d-45da-bf20-4d7774bd86eb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.101882 Nov 08 16:15:13.917999 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 406/815] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:13 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:15:14.151128 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5661e70d-1a06-471d-a066-bdd7cc570f49 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:14.151827 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5661e70d-1a06-471d-a066-bdd7cc570f49 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:14.159730 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5661e70d-1a06-471d-a066-bdd7cc570f49 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:14.160183 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5661e70d-1a06-471d-a066-bdd7cc570f49 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:14.160975 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5661e70d-1a06-471d-a066-bdd7cc570f49 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:14.161409 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5661e70d-1a06-471d-a066-bdd7cc570f49 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:14.309580 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-5661e70d-1a06-471d-a066-bdd7cc570f49 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:14.316880 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5661e70d-1a06-471d-a066-bdd7cc570f49 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.170747 Nov 08 16:15:14.317441 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 410/816] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:14 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:14.914836 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e853a399-a6e5-41fc-8202-39899c98b5aa tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:14.915856 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e853a399-a6e5-41fc-8202-39899c98b5aa tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:14.922619 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e853a399-a6e5-41fc-8202-39899c98b5aa tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:14.923062 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e853a399-a6e5-41fc-8202-39899c98b5aa tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:14.924417 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e853a399-a6e5-41fc-8202-39899c98b5aa tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:14.924850 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e853a399-a6e5-41fc-8202-39899c98b5aa tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:14.929011 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1165c877-cfe4-4476-ba1a-ba80955833c9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:14.929963 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1165c877-cfe4-4476-ba1a-ba80955833c9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:14.936134 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1165c877-cfe4-4476-ba1a-ba80955833c9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:14.936584 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1165c877-cfe4-4476-ba1a-ba80955833c9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:14.937365 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1165c877-cfe4-4476-ba1a-ba80955833c9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:14.937827 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1165c877-cfe4-4476-ba1a-ba80955833c9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:19.127550 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e853a399-a6e5-41fc-8202-39899c98b5aa tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 4.216528 Nov 08 16:15:19.131453 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 407/817] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:14 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 4218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:19.133217 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f89a9ece-47b0-4bd5-92f6-63676dd2949c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:19.133944 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f89a9ece-47b0-4bd5-92f6-63676dd2949c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:19.136888 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1165c877-cfe4-4476-ba1a-ba80955833c9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 4.211284 Nov 08 16:15:19.137893 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 411/818] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:14 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 4213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:15:19.144642 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f89a9ece-47b0-4bd5-92f6-63676dd2949c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:19.145069 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f89a9ece-47b0-4bd5-92f6-63676dd2949c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:19.145871 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f89a9ece-47b0-4bd5-92f6-63676dd2949c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:19.146301 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f89a9ece-47b0-4bd5-92f6-63676dd2949c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:19.308847 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f89a9ece-47b0-4bd5-92f6-63676dd2949c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:19.316262 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f89a9ece-47b0-4bd5-92f6-63676dd2949c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.186642 Nov 08 16:15:19.316814 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 408/819] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:19 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:20.140149 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-667eb826-495d-45d3-b618-89dbf2053803 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:20.141213 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-667eb826-495d-45d3-b618-89dbf2053803 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:20.150362 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c8d545e0-ae35-4a64-988c-1ac5624e6f2a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:20.151491 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-667eb826-495d-45d3-b618-89dbf2053803 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:20.151946 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-667eb826-495d-45d3-b618-89dbf2053803 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:20.152261 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c8d545e0-ae35-4a64-988c-1ac5624e6f2a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:20.152804 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-667eb826-495d-45d3-b618-89dbf2053803 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:20.153246 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-667eb826-495d-45d3-b618-89dbf2053803 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:20.158668 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c8d545e0-ae35-4a64-988c-1ac5624e6f2a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:20.159100 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c8d545e0-ae35-4a64-988c-1ac5624e6f2a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:20.160087 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c8d545e0-ae35-4a64-988c-1ac5624e6f2a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:20.160752 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c8d545e0-ae35-4a64-988c-1ac5624e6f2a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:24.547814 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c8d545e0-ae35-4a64-988c-1ac5624e6f2a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 4.402789 Nov 08 16:15:24.548506 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 409/820] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:20 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 4404 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:15:24.551163 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-667eb826-495d-45d3-b618-89dbf2053803 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 4.415354 Nov 08 16:15:24.552149 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 412/821] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:20 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 4417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:24.553535 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9c68845e-ded9-4ff3-91de-2098bc27607a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:24.554247 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-9c68845e-ded9-4ff3-91de-2098bc27607a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:24.561289 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9c68845e-ded9-4ff3-91de-2098bc27607a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:24.561750 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9c68845e-ded9-4ff3-91de-2098bc27607a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:24.562533 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9c68845e-ded9-4ff3-91de-2098bc27607a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:24.563048 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9c68845e-ded9-4ff3-91de-2098bc27607a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:24.696064 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-9c68845e-ded9-4ff3-91de-2098bc27607a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:24.703814 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-9c68845e-ded9-4ff3-91de-2098bc27607a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.154265 Nov 08 16:15:24.704362 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 410/822] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:24 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:25.560488 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0bb122a3-fe31-4bda-a04e-15f12dc33eae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:25.561485 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0bb122a3-fe31-4bda-a04e-15f12dc33eae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:25.562322 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-85142632-abe0-4d28-8654-a4f9f83f3d89 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:25.563340 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-85142632-abe0-4d28-8654-a4f9f83f3d89 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:25.569132 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0bb122a3-fe31-4bda-a04e-15f12dc33eae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:25.569591 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0bb122a3-fe31-4bda-a04e-15f12dc33eae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:25.569910 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-85142632-abe0-4d28-8654-a4f9f83f3d89 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:25.570356 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-85142632-abe0-4d28-8654-a4f9f83f3d89 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:25.570508 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0bb122a3-fe31-4bda-a04e-15f12dc33eae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:25.570833 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0bb122a3-fe31-4bda-a04e-15f12dc33eae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:25.571117 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-85142632-abe0-4d28-8654-a4f9f83f3d89 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:25.571547 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-85142632-abe0-4d28-8654-a4f9f83f3d89 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:25.658529 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0bb122a3-fe31-4bda-a04e-15f12dc33eae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.102042 Nov 08 16:15:25.659230 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 413/823] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:25 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:15:25.663826 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-85142632-abe0-4d28-8654-a4f9f83f3d89 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.105259 Nov 08 16:15:25.664448 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 411/824] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:25 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:15:25.664607 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2116310621", "imageRef": "9abeafba-e602-4e0a-aab2-62160562de06", "flavorRef": "452", "networks": [{"uuid": "63da175a-847c-472d-b285-2df5d0b798a0"}]}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:25.714166 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.network.neutron [None req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] validate_networks() for [('63da175a-847c-472d-b285-2df5d0b798a0', None, None, None, None, None)] {{(pid=115524) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:15:25.720548 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e3be3208-5349-41ab-a241-2e3d72eff06a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:25.721748 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e3be3208-5349-41ab-a241-2e3d72eff06a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:25.729093 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e3be3208-5349-41ab-a241-2e3d72eff06a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:25.729673 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e3be3208-5349-41ab-a241-2e3d72eff06a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:25.730552 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e3be3208-5349-41ab-a241-2e3d72eff06a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:25.731092 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e3be3208-5349-41ab-a241-2e3d72eff06a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:25.938911 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-e3be3208-5349-41ab-a241-2e3d72eff06a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:25.946729 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e3be3208-5349-41ab-a241-2e3d72eff06a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.230140 Nov 08 16:15:25.947384 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 412/825] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:25 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:15:26.129856 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Flavor limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:15:26.130284 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Image limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:15:26.130762 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Flavor pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:15:26.131169 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Image pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:15:26.131607 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:15:26.140064 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:26.140515 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:26.141325 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:26.141795 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:26.158071 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Getting quotas for project e5e827086bb348d190546b9a0c0ba087. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:15:26.162126 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Getting quotas for user e4ef1300b67b41d5a67626dc96347ab5 and project e5e827086bb348d190546b9a0c0ba087. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:15:26.172566 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Going to run 1 instances... {{(pid=115524) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:15:26.175453 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9abeafba-e602-4e0a-aab2-62160562de06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:15:26.219241 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558345 Nov 08 16:15:26.220093 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 414/826] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Nov 8 16:15:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 16:15:26.229883 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8fb89491-7bf4-45e0-ab32-05e7b4e77b9d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:26.230586 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8fb89491-7bf4-45e0-ab32-05e7b4e77b9d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:26.283516 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8fb89491-7bf4-45e0-ab32-05e7b4e77b9d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:26.290394 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8fb89491-7bf4-45e0-ab32-05e7b4e77b9d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56" status: 200 len: 1219 microversion: 2.1 time: 0.064460 Nov 08 16:15:26.291019 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 413/827] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:26 2021] GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:26.671985 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b0a68b2e-12f8-400f-8974-96d7eeb520be tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:26.672932 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b0a68b2e-12f8-400f-8974-96d7eeb520be tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:26.675814 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0c8843f7-9147-4f29-9a76-cae2f71e315e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:26.676897 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0c8843f7-9147-4f29-9a76-cae2f71e315e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:26.679807 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b0a68b2e-12f8-400f-8974-96d7eeb520be tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:26.680332 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b0a68b2e-12f8-400f-8974-96d7eeb520be tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:26.681185 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b0a68b2e-12f8-400f-8974-96d7eeb520be tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:26.681644 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b0a68b2e-12f8-400f-8974-96d7eeb520be tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:26.684329 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0c8843f7-9147-4f29-9a76-cae2f71e315e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:26.684777 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0c8843f7-9147-4f29-9a76-cae2f71e315e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:26.686722 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0c8843f7-9147-4f29-9a76-cae2f71e315e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:26.687252 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0c8843f7-9147-4f29-9a76-cae2f71e315e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:26.752749 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b0a68b2e-12f8-400f-8974-96d7eeb520be tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.084712 Nov 08 16:15:26.753390 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 415/828] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:26 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:15:26.762793 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0c8843f7-9147-4f29-9a76-cae2f71e315e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.092084 Nov 08 16:15:26.763441 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 414/829] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:26 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:15:26.964497 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4f0a9517-7fa1-4ac1-b26e-ca289ec24cda tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:26.965188 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4f0a9517-7fa1-4ac1-b26e-ca289ec24cda tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:26.972457 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4f0a9517-7fa1-4ac1-b26e-ca289ec24cda tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:26.972766 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4f0a9517-7fa1-4ac1-b26e-ca289ec24cda tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:26.973532 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4f0a9517-7fa1-4ac1-b26e-ca289ec24cda tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:26.974005 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4f0a9517-7fa1-4ac1-b26e-ca289ec24cda tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:27.122817 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4f0a9517-7fa1-4ac1-b26e-ca289ec24cda tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:27.131489 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4f0a9517-7fa1-4ac1-b26e-ca289ec24cda tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.170867 Nov 08 16:15:27.132705 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 416/830] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:26 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:27.309427 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e475be4b-9beb-4794-b5a8-ea5340d47c65 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:27.310139 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e475be4b-9beb-4794-b5a8-ea5340d47c65 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:27.317252 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e475be4b-9beb-4794-b5a8-ea5340d47c65 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:27.317685 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e475be4b-9beb-4794-b5a8-ea5340d47c65 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:27.318638 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e475be4b-9beb-4794-b5a8-ea5340d47c65 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:27.319218 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e475be4b-9beb-4794-b5a8-ea5340d47c65 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:27.393344 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-e475be4b-9beb-4794-b5a8-ea5340d47c65 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:27.402413 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e475be4b-9beb-4794-b5a8-ea5340d47c65 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56" status: 200 len: 1277 microversion: 2.1 time: 0.097587 Nov 08 16:15:27.402975 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 415/831] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:27 2021] GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56 => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:27.764596 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bcbef444-b0ae-4686-b8c7-d170ce17e9ea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:27.765627 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-bcbef444-b0ae-4686-b8c7-d170ce17e9ea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:27.772681 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bcbef444-b0ae-4686-b8c7-d170ce17e9ea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:27.773219 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bcbef444-b0ae-4686-b8c7-d170ce17e9ea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:27.774113 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bcbef444-b0ae-4686-b8c7-d170ce17e9ea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:27.774668 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-43c2176a-1de9-4f3e-84a8-4f0df044e880 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:27.775101 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bcbef444-b0ae-4686-b8c7-d170ce17e9ea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:27.775509 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-43c2176a-1de9-4f3e-84a8-4f0df044e880 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:27.782755 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-43c2176a-1de9-4f3e-84a8-4f0df044e880 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:27.783489 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-43c2176a-1de9-4f3e-84a8-4f0df044e880 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:27.784346 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-43c2176a-1de9-4f3e-84a8-4f0df044e880 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:27.784849 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-43c2176a-1de9-4f3e-84a8-4f0df044e880 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:27.879685 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bcbef444-b0ae-4686-b8c7-d170ce17e9ea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.118690 Nov 08 16:15:27.880422 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 417/832] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:27 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:15:27.883400 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-43c2176a-1de9-4f3e-84a8-4f0df044e880 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.112198 Nov 08 16:15:27.884209 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 416/833] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:27 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:28.149013 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0bd0d532-e61d-4cde-8b8b-bcc40305bd9d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:28.149723 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0bd0d532-e61d-4cde-8b8b-bcc40305bd9d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:28.156524 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0bd0d532-e61d-4cde-8b8b-bcc40305bd9d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:28.156983 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0bd0d532-e61d-4cde-8b8b-bcc40305bd9d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:28.157781 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0bd0d532-e61d-4cde-8b8b-bcc40305bd9d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:28.158222 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0bd0d532-e61d-4cde-8b8b-bcc40305bd9d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:28.397681 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0bd0d532-e61d-4cde-8b8b-bcc40305bd9d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:28.407333 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0bd0d532-e61d-4cde-8b8b-bcc40305bd9d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1520 microversion: 2.1 time: 0.262321 Nov 08 16:15:28.408234 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 418/834] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:28 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:28.426670 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1d8a4942-b739-46e8-8aec-260f9946991f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:28.427700 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1d8a4942-b739-46e8-8aec-260f9946991f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:28.434704 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1d8a4942-b739-46e8-8aec-260f9946991f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:28.435635 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1d8a4942-b739-46e8-8aec-260f9946991f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:28.436679 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1d8a4942-b739-46e8-8aec-260f9946991f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:28.437470 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1d8a4942-b739-46e8-8aec-260f9946991f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:28.602566 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-bb505b0f-430c-4da6-b49e-eebd60fd5303 req-6588d869-93cf-40b9-badf-856648b5b463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "116d828b-58e5-4928-bdf2-4f0f7cb4cd56", "tag": "f510df50-3aa6-4a56-a3f6-1075cc078430"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:28.606818 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:15:28.606818 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:15:28.619900 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-bb505b0f-430c-4da6-b49e-eebd60fd5303 req-6588d869-93cf-40b9-badf-856648b5b463 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:28.620718 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-bb505b0f-430c-4da6-b49e-eebd60fd5303 req-6588d869-93cf-40b9-badf-856648b5b463 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:28.643487 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-bb505b0f-430c-4da6-b49e-eebd60fd5303 req-6588d869-93cf-40b9-badf-856648b5b463 service nova] Creating event network-changed:f510df50-3aa6-4a56-a3f6-1075cc078430 for instance 116d828b-58e5-4928-bdf2-4f0f7cb4cd56 on hv-cinder-81618 Nov 08 16:15:28.668208 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-bb505b0f-430c-4da6-b49e-eebd60fd5303 req-6588d869-93cf-40b9-badf-856648b5b463 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069457 Nov 08 16:15:28.669128 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 419/835] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:15:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:15:28.677581 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1d8a4942-b739-46e8-8aec-260f9946991f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:28.686223 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1d8a4942-b739-46e8-8aec-260f9946991f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56" status: 200 len: 1319 microversion: 2.1 time: 0.266443 Nov 08 16:15:28.687090 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 417/836] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:28 2021] GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:28.893376 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-397ed17b-9aed-46dc-a85d-b4f842d04ec1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:28.894574 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-397ed17b-9aed-46dc-a85d-b4f842d04ec1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:28.895060 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-902e2bfd-fa3c-4ada-861b-159fab9b20ed tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:28.896113 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-902e2bfd-fa3c-4ada-861b-159fab9b20ed tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:28.902547 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-902e2bfd-fa3c-4ada-861b-159fab9b20ed tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:28.904101 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-397ed17b-9aed-46dc-a85d-b4f842d04ec1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:28.905499 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-397ed17b-9aed-46dc-a85d-b4f842d04ec1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:28.907665 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-902e2bfd-fa3c-4ada-861b-159fab9b20ed tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:28.908574 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-902e2bfd-fa3c-4ada-861b-159fab9b20ed tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:28.909532 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-902e2bfd-fa3c-4ada-861b-159fab9b20ed tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:28.912256 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-397ed17b-9aed-46dc-a85d-b4f842d04ec1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:28.912857 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-397ed17b-9aed-46dc-a85d-b4f842d04ec1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:29.016220 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-397ed17b-9aed-46dc-a85d-b4f842d04ec1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.127968 Nov 08 16:15:29.017115 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 420/837] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:28 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:15:29.022163 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-117e15a0-68f3-4d6d-9ade-06e0895f9f6a req-31140195-9c13-42a8-a18c-f098138d59cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f7e3a8-0064-42ad-9e41-03a1ba050703", "name": "network-vif-deleted", "tag": "17db566c-bf28-4091-b7f6-4ffa5f80c982"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:29.023861 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:15:29.023861 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:15:29.030999 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-902e2bfd-fa3c-4ada-861b-159fab9b20ed tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.139623 Nov 08 16:15:29.033741 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 418/838] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:28 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:15:29.035523 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-117e15a0-68f3-4d6d-9ade-06e0895f9f6a req-31140195-9c13-42a8-a18c-f098138d59cd service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:29.035962 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-117e15a0-68f3-4d6d-9ade-06e0895f9f6a req-31140195-9c13-42a8-a18c-f098138d59cd service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:29.047395 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-117e15a0-68f3-4d6d-9ade-06e0895f9f6a req-31140195-9c13-42a8-a18c-f098138d59cd service nova] Creating event network-vif-deleted:17db566c-bf28-4091-b7f6-4ffa5f80c982 for instance 44f7e3a8-0064-42ad-9e41-03a1ba050703 on hv-cinder-81618 Nov 08 16:15:29.052806 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-117e15a0-68f3-4d6d-9ade-06e0895f9f6a req-31140195-9c13-42a8-a18c-f098138d59cd service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034540 Nov 08 16:15:29.053378 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 421/839] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:15:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:15:29.426647 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b99488a1-9ac6-4cd0-87c9-86c43c46f0f5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:29.427625 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b99488a1-9ac6-4cd0-87c9-86c43c46f0f5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:29.435273 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b99488a1-9ac6-4cd0-87c9-86c43c46f0f5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:29.436050 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b99488a1-9ac6-4cd0-87c9-86c43c46f0f5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:29.436786 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b99488a1-9ac6-4cd0-87c9-86c43c46f0f5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:29.437420 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b99488a1-9ac6-4cd0-87c9-86c43c46f0f5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:29.474947 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b99488a1-9ac6-4cd0-87c9-86c43c46f0f5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:29.475394 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b99488a1-9ac6-4cd0-87c9-86c43c46f0f5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:29.475837 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.objects.instance [None req-b99488a1-9ac6-4cd0-87c9-86c43c46f0f5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lazy-loading 'fault' on Instance uuid 44f7e3a8-0064-42ad-9e41-03a1ba050703 {{(pid=115523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:15:29.608516 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b99488a1-9ac6-4cd0-87c9-86c43c46f0f5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a890d933f49c890a7d3788aa61706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:29.615006 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b99488a1-9ac6-4cd0-87c9-86c43c46f0f5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 200 len: 1311 microversion: 2.1 time: 0.193075 Nov 08 16:15:29.615608 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 419/840] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:29 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 1311 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:29.704624 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-83beedb5-a2ed-4eef-84bd-ade7801ce82c tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:29.705347 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-83beedb5-a2ed-4eef-84bd-ade7801ce82c tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:29.711947 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-83beedb5-a2ed-4eef-84bd-ade7801ce82c tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:29.712399 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-83beedb5-a2ed-4eef-84bd-ade7801ce82c tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:29.713182 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-83beedb5-a2ed-4eef-84bd-ade7801ce82c tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:29.713617 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-83beedb5-a2ed-4eef-84bd-ade7801ce82c tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:29.850388 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-83beedb5-a2ed-4eef-84bd-ade7801ce82c tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:29.858106 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-83beedb5-a2ed-4eef-84bd-ade7801ce82c tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56" status: 200 len: 1319 microversion: 2.1 time: 0.157934 Nov 08 16:15:29.865837 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 422/841] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:29 2021] GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:30.027243 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a388b451-258a-42e5-b9f3-c64affffb15d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:30.028698 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a388b451-258a-42e5-b9f3-c64affffb15d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:30.034947 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a388b451-258a-42e5-b9f3-c64affffb15d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:30.035384 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a388b451-258a-42e5-b9f3-c64affffb15d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:30.036143 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a388b451-258a-42e5-b9f3-c64affffb15d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:30.036565 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a388b451-258a-42e5-b9f3-c64affffb15d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:30.043447 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7dba0844-9dec-4488-9935-0a05f78dca41 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:30.044366 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7dba0844-9dec-4488-9935-0a05f78dca41 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:30.050981 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7dba0844-9dec-4488-9935-0a05f78dca41 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:30.051617 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7dba0844-9dec-4488-9935-0a05f78dca41 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:30.052395 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7dba0844-9dec-4488-9935-0a05f78dca41 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:30.052828 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7dba0844-9dec-4488-9935-0a05f78dca41 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:30.744516 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7dba0844-9dec-4488-9935-0a05f78dca41 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.704539 Nov 08 16:15:30.745904 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 423/842] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:30 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:15:30.748036 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a388b451-258a-42e5-b9f3-c64affffb15d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.724218 Nov 08 16:15:30.749414 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 420/843] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:30 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:15:30.750203 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7659de98-efa8-4a50-83d5-036af4a888a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:30.750887 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7659de98-efa8-4a50-83d5-036af4a888a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] [instance: 44f7e3a8-0064-42ad-9e41-03a1ba050703] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:30.757682 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7659de98-efa8-4a50-83d5-036af4a888a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:30.758146 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7659de98-efa8-4a50-83d5-036af4a888a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:30.758918 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7659de98-efa8-4a50-83d5-036af4a888a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:30.759343 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7659de98-efa8-4a50-83d5-036af4a888a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:30.773548 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-7659de98-efa8-4a50-83d5-036af4a888a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] HTTP exception thrown: Instance 44f7e3a8-0064-42ad-9e41-03a1ba050703 could not be found. Nov 08 16:15:30.774153 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7659de98-efa8-4a50-83d5-036af4a888a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Returning 404 to user: Instance 44f7e3a8-0064-42ad-9e41-03a1ba050703 could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:15:30.774957 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7659de98-efa8-4a50-83d5-036af4a888a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703" status: 404 len: 111 microversion: 2.1 time: 0.028690 Nov 08 16:15:30.775598 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 424/844] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:30 2021] GET /compute/v2.1/servers/44f7e3a8-0064-42ad-9e41-03a1ba050703 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:15:30.880676 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-36e441c5-c9a1-420a-8ad8-b1eac40efce8 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:30.881369 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-36e441c5-c9a1-420a-8ad8-b1eac40efce8 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:30.889605 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-36e441c5-c9a1-420a-8ad8-b1eac40efce8 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:30.890074 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-36e441c5-c9a1-420a-8ad8-b1eac40efce8 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:30.890847 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-36e441c5-c9a1-420a-8ad8-b1eac40efce8 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:30.891266 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-36e441c5-c9a1-420a-8ad8-b1eac40efce8 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:31.135143 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-36e441c5-c9a1-420a-8ad8-b1eac40efce8 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:31.142423 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-36e441c5-c9a1-420a-8ad8-b1eac40efce8 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56" status: 200 len: 1319 microversion: 2.1 time: 0.265778 Nov 08 16:15:31.143897 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 421/845] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:30 2021] GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:31.756467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f22c65cb-00ca-4bd5-82da-18dde64bb2d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:31.757619 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f22c65cb-00ca-4bd5-82da-18dde64bb2d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:31.759442 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8045bc67-cd9b-4058-b8b6-277f27069d31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:31.760384 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8045bc67-cd9b-4058-b8b6-277f27069d31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:31.765205 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f22c65cb-00ca-4bd5-82da-18dde64bb2d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:31.765743 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f22c65cb-00ca-4bd5-82da-18dde64bb2d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:31.766557 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f22c65cb-00ca-4bd5-82da-18dde64bb2d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:31.767001 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f22c65cb-00ca-4bd5-82da-18dde64bb2d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:31.767736 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8045bc67-cd9b-4058-b8b6-277f27069d31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:31.768222 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8045bc67-cd9b-4058-b8b6-277f27069d31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:31.769020 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8045bc67-cd9b-4058-b8b6-277f27069d31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:31.769491 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8045bc67-cd9b-4058-b8b6-277f27069d31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:31.915025 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f22c65cb-00ca-4bd5-82da-18dde64bb2d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.162189 Nov 08 16:15:31.915783 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 425/846] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:31 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:31.918760 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8045bc67-cd9b-4058-b8b6-277f27069d31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.162898 Nov 08 16:15:31.919509 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 422/847] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:31 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:15:32.160780 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7ac90d48-0d78-4dbc-8011-2939dc64f59a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:32.161468 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7ac90d48-0d78-4dbc-8011-2939dc64f59a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:32.168401 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7ac90d48-0d78-4dbc-8011-2939dc64f59a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:32.168848 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7ac90d48-0d78-4dbc-8011-2939dc64f59a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:32.169615 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7ac90d48-0d78-4dbc-8011-2939dc64f59a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:32.170075 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7ac90d48-0d78-4dbc-8011-2939dc64f59a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:32.602847 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7ac90d48-0d78-4dbc-8011-2939dc64f59a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:32.613527 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7ac90d48-0d78-4dbc-8011-2939dc64f59a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56" status: 200 len: 1319 microversion: 2.1 time: 0.456976 Nov 08 16:15:32.615246 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 426/848] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:32 2021] GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56 => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:32.928917 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5724ad50-5975-455c-a616-c5e6fc893254 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:32.930182 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-17cf712c-5e56-4b00-b4f5-d0e32a98b914 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:32.930630 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5724ad50-5975-455c-a616-c5e6fc893254 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:32.931098 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-17cf712c-5e56-4b00-b4f5-d0e32a98b914 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:32.937114 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5724ad50-5975-455c-a616-c5e6fc893254 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:32.937817 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5724ad50-5975-455c-a616-c5e6fc893254 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:32.938775 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5724ad50-5975-455c-a616-c5e6fc893254 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:32.939361 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5724ad50-5975-455c-a616-c5e6fc893254 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:32.940308 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-17cf712c-5e56-4b00-b4f5-d0e32a98b914 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:32.940849 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-17cf712c-5e56-4b00-b4f5-d0e32a98b914 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:32.941892 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-17cf712c-5e56-4b00-b4f5-d0e32a98b914 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:32.942405 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-17cf712c-5e56-4b00-b4f5-d0e32a98b914 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:33.067679 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5724ad50-5975-455c-a616-c5e6fc893254 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.143137 Nov 08 16:15:33.068749 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 423/849] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:32 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:33.091708 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-17cf712c-5e56-4b00-b4f5-d0e32a98b914 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.164545 Nov 08 16:15:33.092697 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 427/850] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:32 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:15:33.632013 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4e5722ed-6c00-4b9a-8174-2e67d527a490 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:33.632915 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4e5722ed-6c00-4b9a-8174-2e67d527a490 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:33.643458 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4e5722ed-6c00-4b9a-8174-2e67d527a490 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:33.644274 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4e5722ed-6c00-4b9a-8174-2e67d527a490 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:33.645266 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4e5722ed-6c00-4b9a-8174-2e67d527a490 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:33.645914 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4e5722ed-6c00-4b9a-8174-2e67d527a490 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:33.802646 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4e5722ed-6c00-4b9a-8174-2e67d527a490 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:33.809883 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4e5722ed-6c00-4b9a-8174-2e67d527a490 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56" status: 200 len: 1319 microversion: 2.1 time: 0.182398 Nov 08 16:15:33.810640 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 424/851] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:33 2021] GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:34.083981 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-39e9c415-a92a-4ad5-ae51-cb2486b2f056 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:34.085527 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-39e9c415-a92a-4ad5-ae51-cb2486b2f056 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:34.092943 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-39e9c415-a92a-4ad5-ae51-cb2486b2f056 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:34.093485 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-39e9c415-a92a-4ad5-ae51-cb2486b2f056 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:34.094413 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-39e9c415-a92a-4ad5-ae51-cb2486b2f056 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:34.095249 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-39e9c415-a92a-4ad5-ae51-cb2486b2f056 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:34.103795 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3cabfe1a-f809-4690-8277-49ab7dfa071c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:34.104826 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3cabfe1a-f809-4690-8277-49ab7dfa071c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:34.111289 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3cabfe1a-f809-4690-8277-49ab7dfa071c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:34.111733 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3cabfe1a-f809-4690-8277-49ab7dfa071c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:34.113201 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3cabfe1a-f809-4690-8277-49ab7dfa071c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:34.113629 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3cabfe1a-f809-4690-8277-49ab7dfa071c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:34.167870 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-39e9c415-a92a-4ad5-ae51-cb2486b2f056 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.091736 Nov 08 16:15:34.168732 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 428/852] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:34 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:34.187374 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3cabfe1a-f809-4690-8277-49ab7dfa071c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.087014 Nov 08 16:15:34.188522 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 425/853] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:34 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:15:34.827987 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5a27627a-d1c9-49a5-8601-a9ac5609aa04 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:34.828594 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5a27627a-d1c9-49a5-8601-a9ac5609aa04 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:34.837122 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5a27627a-d1c9-49a5-8601-a9ac5609aa04 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:34.837571 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5a27627a-d1c9-49a5-8601-a9ac5609aa04 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:34.838383 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5a27627a-d1c9-49a5-8601-a9ac5609aa04 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:34.838820 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5a27627a-d1c9-49a5-8601-a9ac5609aa04 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:34.981429 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-5a27627a-d1c9-49a5-8601-a9ac5609aa04 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:34.989405 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5a27627a-d1c9-49a5-8601-a9ac5609aa04 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56" status: 200 len: 1319 microversion: 2.1 time: 0.165750 Nov 08 16:15:34.990406 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 429/854] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:34 2021] GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:35.182558 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-43b6d5b9-35a8-4fbd-a32f-3c092cd7016f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:35.183930 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-43b6d5b9-35a8-4fbd-a32f-3c092cd7016f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:35.191822 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-43b6d5b9-35a8-4fbd-a32f-3c092cd7016f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:35.192497 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-43b6d5b9-35a8-4fbd-a32f-3c092cd7016f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:35.193572 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-43b6d5b9-35a8-4fbd-a32f-3c092cd7016f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:35.200379 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-35e3e54b-1692-460a-996b-2e53afa821d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:35.202262 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-35e3e54b-1692-460a-996b-2e53afa821d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:35.205946 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-43b6d5b9-35a8-4fbd-a32f-3c092cd7016f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:35.212526 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-35e3e54b-1692-460a-996b-2e53afa821d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:35.213076 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-35e3e54b-1692-460a-996b-2e53afa821d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:35.213894 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-35e3e54b-1692-460a-996b-2e53afa821d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:35.214326 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-35e3e54b-1692-460a-996b-2e53afa821d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:35.352204 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-43b6d5b9-35a8-4fbd-a32f-3c092cd7016f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.174937 Nov 08 16:15:35.356632 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-35e3e54b-1692-460a-996b-2e53afa821d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.159592 Nov 08 16:15:35.356918 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 430/855] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:35 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:15:35.357508 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 426/856] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:35 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:36.008048 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f8afdc1d-dc66-47ba-aeb3-a44ecd115c25 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:36.008651 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f8afdc1d-dc66-47ba-aeb3-a44ecd115c25 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:36.015414 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8afdc1d-dc66-47ba-aeb3-a44ecd115c25 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:36.015863 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8afdc1d-dc66-47ba-aeb3-a44ecd115c25 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:36.016638 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8afdc1d-dc66-47ba-aeb3-a44ecd115c25 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:36.017070 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8afdc1d-dc66-47ba-aeb3-a44ecd115c25 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:36.144242 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f8afdc1d-dc66-47ba-aeb3-a44ecd115c25 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:36.151896 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f8afdc1d-dc66-47ba-aeb3-a44ecd115c25 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56" status: 200 len: 1319 microversion: 2.1 time: 0.148020 Nov 08 16:15:36.152458 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 431/857] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:36 2021] GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:36.363877 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f75dfd71-780f-49fa-8488-ae85ab363b92 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:36.364866 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f75dfd71-780f-49fa-8488-ae85ab363b92 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:36.366825 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e4a95d29-9985-4e51-9778-695847ffcae9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:36.367745 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e4a95d29-9985-4e51-9778-695847ffcae9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:36.372092 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f75dfd71-780f-49fa-8488-ae85ab363b92 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:36.372530 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f75dfd71-780f-49fa-8488-ae85ab363b92 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:36.373293 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f75dfd71-780f-49fa-8488-ae85ab363b92 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:36.373871 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f75dfd71-780f-49fa-8488-ae85ab363b92 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:36.374149 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e4a95d29-9985-4e51-9778-695847ffcae9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:36.374602 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e4a95d29-9985-4e51-9778-695847ffcae9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:36.375380 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e4a95d29-9985-4e51-9778-695847ffcae9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:36.375822 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e4a95d29-9985-4e51-9778-695847ffcae9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:36.579027 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f75dfd71-780f-49fa-8488-ae85ab363b92 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.218946 Nov 08 16:15:36.579824 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 427/858] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:36 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:36.585268 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e4a95d29-9985-4e51-9778-695847ffcae9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.222002 Nov 08 16:15:36.585953 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 432/859] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:36 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:15:37.168727 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a535a21b-e709-4f82-a49c-3c9305ffd1e7 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:37.169415 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a535a21b-e709-4f82-a49c-3c9305ffd1e7 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:37.176841 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a535a21b-e709-4f82-a49c-3c9305ffd1e7 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:37.177312 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a535a21b-e709-4f82-a49c-3c9305ffd1e7 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:37.178112 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a535a21b-e709-4f82-a49c-3c9305ffd1e7 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:37.178539 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a535a21b-e709-4f82-a49c-3c9305ffd1e7 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:37.324559 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-4da82691-5bd1-48b3-b5f5-78b602edbe5b req-08bee0a3-8d6e-499f-9a66-065127410a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "116d828b-58e5-4928-bdf2-4f0f7cb4cd56", "name": "network-vif-plugged", "status": "completed", "tag": "f510df50-3aa6-4a56-a3f6-1075cc078430"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:37.328056 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:15:37.328056 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:15:37.336684 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a535a21b-e709-4f82-a49c-3c9305ffd1e7 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:37.351454 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-4da82691-5bd1-48b3-b5f5-78b602edbe5b req-08bee0a3-8d6e-499f-9a66-065127410a92 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:37.354591 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-4da82691-5bd1-48b3-b5f5-78b602edbe5b req-08bee0a3-8d6e-499f-9a66-065127410a92 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:37.357981 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a535a21b-e709-4f82-a49c-3c9305ffd1e7 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56" status: 200 len: 1319 microversion: 2.1 time: 0.191356 Nov 08 16:15:37.358928 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 428/860] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:37 2021] GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:37.373748 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-4da82691-5bd1-48b3-b5f5-78b602edbe5b req-08bee0a3-8d6e-499f-9a66-065127410a92 service nova] Creating event network-vif-plugged:f510df50-3aa6-4a56-a3f6-1075cc078430 for instance 116d828b-58e5-4928-bdf2-4f0f7cb4cd56 on hv-cinder-81618 Nov 08 16:15:37.380829 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-4da82691-5bd1-48b3-b5f5-78b602edbe5b req-08bee0a3-8d6e-499f-9a66-065127410a92 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062602 Nov 08 16:15:37.381939 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 433/861] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:15:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:15:37.591137 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1988bc8b-e935-405b-8912-f488626d06c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:37.592704 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1988bc8b-e935-405b-8912-f488626d06c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:37.599570 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1988bc8b-e935-405b-8912-f488626d06c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:37.600112 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1988bc8b-e935-405b-8912-f488626d06c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:37.600786 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1988bc8b-e935-405b-8912-f488626d06c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:37.601567 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1988bc8b-e935-405b-8912-f488626d06c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:37.606321 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-98acf048-8152-4f3c-a4b1-8622beeded6a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:37.607329 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-98acf048-8152-4f3c-a4b1-8622beeded6a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:37.613685 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-98acf048-8152-4f3c-a4b1-8622beeded6a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:37.614148 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-98acf048-8152-4f3c-a4b1-8622beeded6a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:37.614928 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-98acf048-8152-4f3c-a4b1-8622beeded6a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:37.615495 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-98acf048-8152-4f3c-a4b1-8622beeded6a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:38.087550 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1988bc8b-e935-405b-8912-f488626d06c0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.499911 Nov 08 16:15:38.088205 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 429/862] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:37 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:38.091887 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-98acf048-8152-4f3c-a4b1-8622beeded6a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.499126 Nov 08 16:15:38.095749 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 434/863] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:37 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:15:38.375795 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b5af4f38-9221-414a-bb0f-f78907536d2b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:38.376495 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b5af4f38-9221-414a-bb0f-f78907536d2b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:38.383790 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b5af4f38-9221-414a-bb0f-f78907536d2b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:38.384234 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b5af4f38-9221-414a-bb0f-f78907536d2b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:38.385016 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b5af4f38-9221-414a-bb0f-f78907536d2b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:38.385449 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b5af4f38-9221-414a-bb0f-f78907536d2b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:38.516284 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b5af4f38-9221-414a-bb0f-f78907536d2b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:38.524677 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b5af4f38-9221-414a-bb0f-f78907536d2b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56" status: 200 len: 1319 microversion: 2.1 time: 0.153389 Nov 08 16:15:38.525244 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 430/864] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:38 2021] GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:39.100475 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-6254ecb3-5922-41a3-81be-dbc9ffa5b0cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:39.101480 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-6254ecb3-5922-41a3-81be-dbc9ffa5b0cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:39.103655 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b47b8c0b-b053-4fed-8407-63f4e8ad9d9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:39.104555 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b47b8c0b-b053-4fed-8407-63f4e8ad9d9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:39.108655 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6254ecb3-5922-41a3-81be-dbc9ffa5b0cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:39.109114 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6254ecb3-5922-41a3-81be-dbc9ffa5b0cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:39.109944 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6254ecb3-5922-41a3-81be-dbc9ffa5b0cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:39.110387 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6254ecb3-5922-41a3-81be-dbc9ffa5b0cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:39.110919 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b47b8c0b-b053-4fed-8407-63f4e8ad9d9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:39.111362 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b47b8c0b-b053-4fed-8407-63f4e8ad9d9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:39.112126 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b47b8c0b-b053-4fed-8407-63f4e8ad9d9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:39.112617 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b47b8c0b-b053-4fed-8407-63f4e8ad9d9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:39.171915 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-6254ecb3-5922-41a3-81be-dbc9ffa5b0cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.075991 Nov 08 16:15:39.172543 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 435/865] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:39 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:39.196706 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b47b8c0b-b053-4fed-8407-63f4e8ad9d9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.096436 Nov 08 16:15:39.197354 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 431/866] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:39 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:15:39.541593 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-12f19511-72c1-4d07-85fc-651991220dce tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:15:39.542506 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-12f19511-72c1-4d07-85fc-651991220dce tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:39.549799 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-12f19511-72c1-4d07-85fc-651991220dce tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:39.550342 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-12f19511-72c1-4d07-85fc-651991220dce tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:39.551262 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-12f19511-72c1-4d07-85fc-651991220dce tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:39.551755 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-12f19511-72c1-4d07-85fc-651991220dce tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:39.695045 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-12f19511-72c1-4d07-85fc-651991220dce tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:15:39.702623 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-12f19511-72c1-4d07-85fc-651991220dce tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56" status: 200 len: 1508 microversion: 2.1 time: 0.165066 Nov 08 16:15:39.715037 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 436/867] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:15:39 2021] GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:15:39.723107 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-cfeb7491-422b-419f-8a01-c5d2db59003d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1df123e2-4b89-4705-ad0d-2057e3da640b", "device": "/dev/sdb"}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:39.724735 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-cfeb7491-422b-419f-8a01-c5d2db59003d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:39.732018 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cfeb7491-422b-419f-8a01-c5d2db59003d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:39.732456 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cfeb7491-422b-419f-8a01-c5d2db59003d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:39.733225 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cfeb7491-422b-419f-8a01-c5d2db59003d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:39.733651 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cfeb7491-422b-419f-8a01-c5d2db59003d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:40.183474 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a8a51871-b45f-408a-a072-56efefd25543 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:40.184320 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a8a51871-b45f-408a-a072-56efefd25543 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:40.190605 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a8a51871-b45f-408a-a072-56efefd25543 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:40.191055 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a8a51871-b45f-408a-a072-56efefd25543 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:40.191828 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a8a51871-b45f-408a-a072-56efefd25543 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:40.192265 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a8a51871-b45f-408a-a072-56efefd25543 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:43.727152 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a8a51871-b45f-408a-a072-56efefd25543 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 3.547158 Nov 08 16:15:43.727822 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 437/868] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:40 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 3549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:15:43.732688 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bbcacaaa-ee00-432e-bb02-51d62c658062 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:43.733672 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-bbcacaaa-ee00-432e-bb02-51d62c658062 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:43.740499 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bbcacaaa-ee00-432e-bb02-51d62c658062 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:43.740945 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bbcacaaa-ee00-432e-bb02-51d62c658062 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:43.741730 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bbcacaaa-ee00-432e-bb02-51d62c658062 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:43.742183 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bbcacaaa-ee00-432e-bb02-51d62c658062 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:43.810785 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bbcacaaa-ee00-432e-bb02-51d62c658062 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.081685 Nov 08 16:15:43.811692 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 438/869] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:43 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:15:43.849205 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-cfeb7491-422b-419f-8a01-c5d2db59003d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "POST /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.129998 Nov 08 16:15:43.850007 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 432/870] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Nov 8 16:15:39 2021] POST /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56/os-volume_attachments => generated 194 bytes in 4132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:15:44.740074 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-fa7067c3-0e63-48a2-ba11-18ecea7d8c50 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:44.740979 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-fa7067c3-0e63-48a2-ba11-18ecea7d8c50 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:44.748098 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fa7067c3-0e63-48a2-ba11-18ecea7d8c50 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:44.748573 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fa7067c3-0e63-48a2-ba11-18ecea7d8c50 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:44.749336 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fa7067c3-0e63-48a2-ba11-18ecea7d8c50 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:44.749794 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fa7067c3-0e63-48a2-ba11-18ecea7d8c50 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:44.822493 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-62f54b24-d77d-4c26-8976-cf13e2019c94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:44.823527 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-62f54b24-d77d-4c26-8976-cf13e2019c94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:44.829931 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-62f54b24-d77d-4c26-8976-cf13e2019c94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:44.830369 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-62f54b24-d77d-4c26-8976-cf13e2019c94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:44.831631 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-62f54b24-d77d-4c26-8976-cf13e2019c94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:44.832053 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-62f54b24-d77d-4c26-8976-cf13e2019c94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:45.168419 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-fa7067c3-0e63-48a2-ba11-18ecea7d8c50 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.432863 Nov 08 16:15:45.169154 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 439/871] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:44 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:45.176723 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-62f54b24-d77d-4c26-8976-cf13e2019c94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.358539 Nov 08 16:15:45.178171 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 433/872] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:44 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:15:46.181163 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4b9ca8ce-b5ff-4d99-9144-1fa324fe241a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:46.182204 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4b9ca8ce-b5ff-4d99-9144-1fa324fe241a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:46.188807 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e2ffbf77-6142-4159-b1cc-cad6327876a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:46.189277 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b9ca8ce-b5ff-4d99-9144-1fa324fe241a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:46.189425 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b9ca8ce-b5ff-4d99-9144-1fa324fe241a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:46.189802 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e2ffbf77-6142-4159-b1cc-cad6327876a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:46.190221 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b9ca8ce-b5ff-4d99-9144-1fa324fe241a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:46.190686 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b9ca8ce-b5ff-4d99-9144-1fa324fe241a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:46.196578 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e2ffbf77-6142-4159-b1cc-cad6327876a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:46.197016 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e2ffbf77-6142-4159-b1cc-cad6327876a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:46.197811 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e2ffbf77-6142-4159-b1cc-cad6327876a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:46.198242 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e2ffbf77-6142-4159-b1cc-cad6327876a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:48.001334 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4b9ca8ce-b5ff-4d99-9144-1fa324fe241a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 1.824011 Nov 08 16:15:48.002398 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 440/873] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:46 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:48.024149 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e2ffbf77-6142-4159-b1cc-cad6327876a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 1.839225 Nov 08 16:15:48.025049 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 434/874] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:46 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:15:49.012952 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b9d86937-78bd-4b2a-90ec-b9e853fe6645 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:49.013970 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b9d86937-78bd-4b2a-90ec-b9e853fe6645 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:49.021424 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b9d86937-78bd-4b2a-90ec-b9e853fe6645 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:49.021902 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b9d86937-78bd-4b2a-90ec-b9e853fe6645 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:49.022666 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b9d86937-78bd-4b2a-90ec-b9e853fe6645 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:49.023096 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b9d86937-78bd-4b2a-90ec-b9e853fe6645 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:49.036706 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e23c09ec-dcee-4194-9b74-6b9b5f087e5c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:49.037747 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e23c09ec-dcee-4194-9b74-6b9b5f087e5c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:49.045044 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e23c09ec-dcee-4194-9b74-6b9b5f087e5c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:49.045492 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e23c09ec-dcee-4194-9b74-6b9b5f087e5c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:49.046296 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e23c09ec-dcee-4194-9b74-6b9b5f087e5c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:49.046729 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e23c09ec-dcee-4194-9b74-6b9b5f087e5c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:49.090388 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b9d86937-78bd-4b2a-90ec-b9e853fe6645 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.081225 Nov 08 16:15:49.091058 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 441/875] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:49 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:15:49.113113 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e23c09ec-dcee-4194-9b74-6b9b5f087e5c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.080149 Nov 08 16:15:49.114623 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 435/876] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:49 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:15:50.103330 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-87cb4649-103a-4838-a7f8-97c67b679755 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:50.104358 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-87cb4649-103a-4838-a7f8-97c67b679755 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:50.111390 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-87cb4649-103a-4838-a7f8-97c67b679755 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:50.111832 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-87cb4649-103a-4838-a7f8-97c67b679755 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:50.112631 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-87cb4649-103a-4838-a7f8-97c67b679755 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:50.113061 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-87cb4649-103a-4838-a7f8-97c67b679755 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:50.125318 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c6c5c244-d319-4d31-8aac-e6fd3b5938df tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:50.126339 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c6c5c244-d319-4d31-8aac-e6fd3b5938df tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:50.133201 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c6c5c244-d319-4d31-8aac-e6fd3b5938df tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:50.133643 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c6c5c244-d319-4d31-8aac-e6fd3b5938df tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:50.134447 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c6c5c244-d319-4d31-8aac-e6fd3b5938df tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:50.134876 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c6c5c244-d319-4d31-8aac-e6fd3b5938df tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:50.181369 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-87cb4649-103a-4838-a7f8-97c67b679755 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.082007 Nov 08 16:15:50.182076 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 442/877] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:50 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:50.203110 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c6c5c244-d319-4d31-8aac-e6fd3b5938df tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.081732 Nov 08 16:15:50.204344 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 436/878] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:50 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:15:51.193677 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-6df5d036-3115-4cef-9f69-76673930ac5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:51.194702 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-6df5d036-3115-4cef-9f69-76673930ac5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:51.201512 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6df5d036-3115-4cef-9f69-76673930ac5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:51.202070 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6df5d036-3115-4cef-9f69-76673930ac5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:51.202745 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6df5d036-3115-4cef-9f69-76673930ac5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:51.203174 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6df5d036-3115-4cef-9f69-76673930ac5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:51.216852 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-23659a27-b8cc-4e3a-8671-6c6e7e84e2ac tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:51.217970 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-23659a27-b8cc-4e3a-8671-6c6e7e84e2ac tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:51.225122 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-23659a27-b8cc-4e3a-8671-6c6e7e84e2ac tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:51.225573 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-23659a27-b8cc-4e3a-8671-6c6e7e84e2ac tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:51.226382 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-23659a27-b8cc-4e3a-8671-6c6e7e84e2ac tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:51.226818 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-23659a27-b8cc-4e3a-8671-6c6e7e84e2ac tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:51.274741 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-6df5d036-3115-4cef-9f69-76673930ac5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.085652 Nov 08 16:15:51.275664 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 443/879] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:51 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:15:51.303212 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-23659a27-b8cc-4e3a-8671-6c6e7e84e2ac tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.090279 Nov 08 16:15:51.303870 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 437/880] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:51 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:15:52.288460 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b2a853fd-6f9e-4f7e-94cd-aefcf9459ff2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:52.290130 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b2a853fd-6f9e-4f7e-94cd-aefcf9459ff2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:52.297661 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b2a853fd-6f9e-4f7e-94cd-aefcf9459ff2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:52.298134 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b2a853fd-6f9e-4f7e-94cd-aefcf9459ff2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:52.298961 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b2a853fd-6f9e-4f7e-94cd-aefcf9459ff2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:52.299396 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b2a853fd-6f9e-4f7e-94cd-aefcf9459ff2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:52.315887 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-55ebf854-360a-4314-b02a-1b07881ceead tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:52.317916 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-55ebf854-360a-4314-b02a-1b07881ceead tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:52.324831 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-55ebf854-360a-4314-b02a-1b07881ceead tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:52.325237 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-55ebf854-360a-4314-b02a-1b07881ceead tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:52.326171 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-55ebf854-360a-4314-b02a-1b07881ceead tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:52.326508 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-55ebf854-360a-4314-b02a-1b07881ceead tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:52.368999 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b2a853fd-6f9e-4f7e-94cd-aefcf9459ff2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.084683 Nov 08 16:15:52.369932 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 444/881] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:52 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:52.400884 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-55ebf854-360a-4314-b02a-1b07881ceead tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.089520 Nov 08 16:15:52.401833 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 438/882] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:52 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:15:53.381001 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-795073ed-e359-4e68-9072-81135701f0d2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:53.382117 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-795073ed-e359-4e68-9072-81135701f0d2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:53.390007 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-795073ed-e359-4e68-9072-81135701f0d2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:53.390460 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-795073ed-e359-4e68-9072-81135701f0d2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:53.391248 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-795073ed-e359-4e68-9072-81135701f0d2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:53.391690 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-795073ed-e359-4e68-9072-81135701f0d2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:53.419245 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8ced5cf6-2473-475c-a978-0d421870a13e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:53.420833 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8ced5cf6-2473-475c-a978-0d421870a13e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:53.430991 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8ced5cf6-2473-475c-a978-0d421870a13e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:53.431435 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8ced5cf6-2473-475c-a978-0d421870a13e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:53.432515 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8ced5cf6-2473-475c-a978-0d421870a13e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:53.434213 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8ced5cf6-2473-475c-a978-0d421870a13e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:56.965226 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-795073ed-e359-4e68-9072-81135701f0d2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 3.588208 Nov 08 16:15:56.966187 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 445/883] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:53 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 3590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:15:56.969461 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8ced5cf6-2473-475c-a978-0d421870a13e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 3.559935 Nov 08 16:15:56.970127 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 439/884] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:53 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 3562 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:15:57.979758 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f306506f-1d9d-4250-b10f-fb6c58f54da2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:57.980758 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f306506f-1d9d-4250-b10f-fb6c58f54da2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:57.982286 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-79c52432-7da4-4804-89ff-f99862414ac9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:57.983280 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-79c52432-7da4-4804-89ff-f99862414ac9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:57.989646 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f306506f-1d9d-4250-b10f-fb6c58f54da2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:57.990423 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f306506f-1d9d-4250-b10f-fb6c58f54da2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:57.991259 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f306506f-1d9d-4250-b10f-fb6c58f54da2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:57.991858 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-79c52432-7da4-4804-89ff-f99862414ac9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:57.991981 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f306506f-1d9d-4250-b10f-fb6c58f54da2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:57.992351 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-79c52432-7da4-4804-89ff-f99862414ac9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:57.993443 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-79c52432-7da4-4804-89ff-f99862414ac9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:57.994108 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-79c52432-7da4-4804-89ff-f99862414ac9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:58.069266 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f306506f-1d9d-4250-b10f-fb6c58f54da2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.095910 Nov 08 16:15:58.073207 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-79c52432-7da4-4804-89ff-f99862414ac9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.096087 Nov 08 16:15:58.077283 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 440/885] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:57 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:15:58.077441 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 446/886] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:57 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:15:59.088997 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9f2a9119-5381-4d56-89ec-42172bfa3af9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:59.090106 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-9f2a9119-5381-4d56-89ec-42172bfa3af9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:59.091150 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-65990210-aea7-40bd-9891-37f7f645b441 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:15:59.092520 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-65990210-aea7-40bd-9891-37f7f645b441 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:15:59.097387 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9f2a9119-5381-4d56-89ec-42172bfa3af9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:59.098724 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9f2a9119-5381-4d56-89ec-42172bfa3af9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:59.099703 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9f2a9119-5381-4d56-89ec-42172bfa3af9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:59.099851 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-65990210-aea7-40bd-9891-37f7f645b441 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:59.100245 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-65990210-aea7-40bd-9891-37f7f645b441 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:59.100772 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9f2a9119-5381-4d56-89ec-42172bfa3af9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:59.101019 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-65990210-aea7-40bd-9891-37f7f645b441 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:15:59.101459 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-65990210-aea7-40bd-9891-37f7f645b441 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:15:59.208274 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-9f2a9119-5381-4d56-89ec-42172bfa3af9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.123232 Nov 08 16:15:59.208933 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 441/887] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:15:59 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:15:59.217560 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-65990210-aea7-40bd-9891-37f7f645b441 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.132272 Nov 08 16:15:59.222367 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 447/888] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:15:59 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:16:00.223255 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-03ffff5e-5f3d-4560-a2d7-24bea95c7cef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:00.244516 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3b8a28d6-cabe-490c-960f-f02008567c1f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:00.247355 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3b8a28d6-cabe-490c-960f-f02008567c1f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:00.247706 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-03ffff5e-5f3d-4560-a2d7-24bea95c7cef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:00.264008 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3b8a28d6-cabe-490c-960f-f02008567c1f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:00.267281 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-03ffff5e-5f3d-4560-a2d7-24bea95c7cef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:00.267778 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-03ffff5e-5f3d-4560-a2d7-24bea95c7cef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:00.268655 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3b8a28d6-cabe-490c-960f-f02008567c1f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:00.270675 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3b8a28d6-cabe-490c-960f-f02008567c1f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:00.271118 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3b8a28d6-cabe-490c-960f-f02008567c1f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:00.272414 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-03ffff5e-5f3d-4560-a2d7-24bea95c7cef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:00.272875 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-03ffff5e-5f3d-4560-a2d7-24bea95c7cef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:00.370920 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3b8a28d6-cabe-490c-960f-f02008567c1f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.143813 Nov 08 16:16:00.371902 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 448/889] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:16:00 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:16:00.382515 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-03ffff5e-5f3d-4560-a2d7-24bea95c7cef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.166105 Nov 08 16:16:00.389310 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 442/890] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:16:00 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:16:01.383535 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4a70e149-2cb9-4d86-a67e-60ed89edd502 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:01.384501 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4a70e149-2cb9-4d86-a67e-60ed89edd502 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:01.391326 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a70e149-2cb9-4d86-a67e-60ed89edd502 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:01.391820 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a70e149-2cb9-4d86-a67e-60ed89edd502 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:01.392531 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a70e149-2cb9-4d86-a67e-60ed89edd502 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:01.392963 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a70e149-2cb9-4d86-a67e-60ed89edd502 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:01.435427 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-7062ef3a-66f5-4809-9ddb-8e0f74ca6f31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:01.436423 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-7062ef3a-66f5-4809-9ddb-8e0f74ca6f31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:01.443336 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7062ef3a-66f5-4809-9ddb-8e0f74ca6f31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:01.444006 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7062ef3a-66f5-4809-9ddb-8e0f74ca6f31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:01.444791 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7062ef3a-66f5-4809-9ddb-8e0f74ca6f31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:01.445229 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7062ef3a-66f5-4809-9ddb-8e0f74ca6f31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:03.211559 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4a70e149-2cb9-4d86-a67e-60ed89edd502 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 1.831872 Nov 08 16:16:03.212539 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 449/891] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:16:01 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:16:03.216138 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-7062ef3a-66f5-4809-9ddb-8e0f74ca6f31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 1.784652 Nov 08 16:16:03.216768 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 443/892] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:16:01 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:16:04.224180 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-80a006fd-4bc1-426c-9454-d4dcab5f0616 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:04.225173 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-80a006fd-4bc1-426c-9454-d4dcab5f0616 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:04.228503 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c686deeb-28c8-4cb2-a64b-b5600bac409e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:04.229485 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c686deeb-28c8-4cb2-a64b-b5600bac409e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:04.232671 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-80a006fd-4bc1-426c-9454-d4dcab5f0616 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:04.233115 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-80a006fd-4bc1-426c-9454-d4dcab5f0616 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:04.233909 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-80a006fd-4bc1-426c-9454-d4dcab5f0616 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:04.234343 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-80a006fd-4bc1-426c-9454-d4dcab5f0616 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:04.236854 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c686deeb-28c8-4cb2-a64b-b5600bac409e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:04.237299 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c686deeb-28c8-4cb2-a64b-b5600bac409e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:04.238786 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c686deeb-28c8-4cb2-a64b-b5600bac409e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:04.239224 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c686deeb-28c8-4cb2-a64b-b5600bac409e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:04.452519 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-80a006fd-4bc1-426c-9454-d4dcab5f0616 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.232709 Nov 08 16:16:04.454068 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 450/893] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:16:04 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:16:04.458113 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c686deeb-28c8-4cb2-a64b-b5600bac409e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.233404 Nov 08 16:16:04.458977 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 444/894] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:16:04 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:16:05.464672 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0abc330a-a93c-44af-b21b-bf69ebf6f2a3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:05.465736 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0abc330a-a93c-44af-b21b-bf69ebf6f2a3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:05.470045 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-bce0cec0-4eb3-4e02-9377-695e1ad42bd8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:05.471032 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-bce0cec0-4eb3-4e02-9377-695e1ad42bd8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:05.473244 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0abc330a-a93c-44af-b21b-bf69ebf6f2a3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:05.473697 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0abc330a-a93c-44af-b21b-bf69ebf6f2a3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:05.474566 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0abc330a-a93c-44af-b21b-bf69ebf6f2a3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:05.474927 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0abc330a-a93c-44af-b21b-bf69ebf6f2a3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:05.479115 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bce0cec0-4eb3-4e02-9377-695e1ad42bd8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:05.479115 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bce0cec0-4eb3-4e02-9377-695e1ad42bd8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:05.479571 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bce0cec0-4eb3-4e02-9377-695e1ad42bd8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:05.480007 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bce0cec0-4eb3-4e02-9377-695e1ad42bd8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:05.655533 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-bce0cec0-4eb3-4e02-9377-695e1ad42bd8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 28629 microversion: 2.20 time: 0.189239 Nov 08 16:16:05.656111 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 445/895] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:16:05 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 28629 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:16:05.669205 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0abc330a-a93c-44af-b21b-bf69ebf6f2a3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.208405 Nov 08 16:16:05.669864 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 451/896] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:16:05 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:16:06.667641 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0411e2d8-3a84-4c49-82d6-8f850fefec3e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:06.668649 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0411e2d8-3a84-4c49-82d6-8f850fefec3e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:06.675536 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0411e2d8-3a84-4c49-82d6-8f850fefec3e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:06.675971 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0411e2d8-3a84-4c49-82d6-8f850fefec3e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:06.676732 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0411e2d8-3a84-4c49-82d6-8f850fefec3e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:06.677160 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0411e2d8-3a84-4c49-82d6-8f850fefec3e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:06.680840 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d011161b-c4f2-4d93-b7cc-866e3e7d6408 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:06.681891 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d011161b-c4f2-4d93-b7cc-866e3e7d6408 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:06.688871 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d011161b-c4f2-4d93-b7cc-866e3e7d6408 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:06.689345 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d011161b-c4f2-4d93-b7cc-866e3e7d6408 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:06.690291 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d011161b-c4f2-4d93-b7cc-866e3e7d6408 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:06.690724 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d011161b-c4f2-4d93-b7cc-866e3e7d6408 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:06.792756 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0411e2d8-3a84-4c49-82d6-8f850fefec3e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 29999 microversion: 2.20 time: 0.128513 Nov 08 16:16:06.794391 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 446/897] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:16:06 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 29999 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:16:06.797012 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d011161b-c4f2-4d93-b7cc-866e3e7d6408 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.120051 Nov 08 16:16:06.797670 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 452/898] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:16:06 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:16:07.736377 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 16:16:07.736872 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: Mon Nov 8 16:16:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 16:16:07.805927 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-71d454e9-32de-4753-a0be-cc270099c35f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:07.806964 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-71d454e9-32de-4753-a0be-cc270099c35f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:07.808542 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0e11006b-08b2-456b-acc3-e81415874b0c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:07.809544 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0e11006b-08b2-456b-acc3-e81415874b0c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:07.814457 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-71d454e9-32de-4753-a0be-cc270099c35f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:07.814911 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-71d454e9-32de-4753-a0be-cc270099c35f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:07.815687 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-71d454e9-32de-4753-a0be-cc270099c35f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:07.816152 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-71d454e9-32de-4753-a0be-cc270099c35f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:07.816298 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0e11006b-08b2-456b-acc3-e81415874b0c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:07.816766 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0e11006b-08b2-456b-acc3-e81415874b0c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:07.817568 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0e11006b-08b2-456b-acc3-e81415874b0c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:07.818043 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0e11006b-08b2-456b-acc3-e81415874b0c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:10.059251 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0e11006b-08b2-456b-acc3-e81415874b0c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 2.254305 Nov 08 16:16:10.059917 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 453/899] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:16:07 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 2256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:16:11.105088 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-34ff5c02-0bbb-4151-a188-32bea855d2b3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:11.106104 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-34ff5c02-0bbb-4151-a188-32bea855d2b3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:11.113595 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-34ff5c02-0bbb-4151-a188-32bea855d2b3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:11.114049 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-34ff5c02-0bbb-4151-a188-32bea855d2b3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:11.114826 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-34ff5c02-0bbb-4151-a188-32bea855d2b3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:11.115261 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-34ff5c02-0bbb-4151-a188-32bea855d2b3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:11.300492 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-71d454e9-32de-4753-a0be-cc270099c35f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 36109 microversion: 2.20 time: 3.498573 Nov 08 16:16:11.301185 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 447/900] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:16:07 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 36109 bytes in 3501 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:16:11.334201 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-34ff5c02-0bbb-4151-a188-32bea855d2b3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.232933 Nov 08 16:16:11.334876 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 454/901] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:16:11 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:16:12.312800 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-852a91fc-99eb-49ef-9e31-3df6d8c12596 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:12.314500 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-852a91fc-99eb-49ef-9e31-3df6d8c12596 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:12.321343 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-852a91fc-99eb-49ef-9e31-3df6d8c12596 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:12.321885 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-852a91fc-99eb-49ef-9e31-3df6d8c12596 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:12.322666 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-852a91fc-99eb-49ef-9e31-3df6d8c12596 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:12.323100 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-852a91fc-99eb-49ef-9e31-3df6d8c12596 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:12.346265 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-33717d81-7490-4323-b78b-0fe9b958ea30 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:12.348343 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-33717d81-7490-4323-b78b-0fe9b958ea30 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:12.354799 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-33717d81-7490-4323-b78b-0fe9b958ea30 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:12.355251 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-33717d81-7490-4323-b78b-0fe9b958ea30 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:12.356031 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-33717d81-7490-4323-b78b-0fe9b958ea30 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:12.356468 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-33717d81-7490-4323-b78b-0fe9b958ea30 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:12.402465 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-852a91fc-99eb-49ef-9e31-3df6d8c12596 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 37591 microversion: 2.20 time: 0.093573 Nov 08 16:16:12.403189 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 448/902] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:16:12 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 37591 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:16:12.447192 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-33717d81-7490-4323-b78b-0fe9b958ea30 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 28603 microversion: 2.1 time: 0.104730 Nov 08 16:16:12.449814 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 455/903] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:16:12 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 28603 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:16:13.415437 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-34e40e48-a04b-433b-a10a-5f6c1af23173 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:13.416656 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-34e40e48-a04b-433b-a10a-5f6c1af23173 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:13.423784 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-34e40e48-a04b-433b-a10a-5f6c1af23173 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:13.424219 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-34e40e48-a04b-433b-a10a-5f6c1af23173 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:13.424980 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-34e40e48-a04b-433b-a10a-5f6c1af23173 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:13.425980 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-34e40e48-a04b-433b-a10a-5f6c1af23173 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:13.458540 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0582616b-dedf-4f7f-8ae5-6739fcd194d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:13.459627 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0582616b-dedf-4f7f-8ae5-6739fcd194d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:13.466588 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0582616b-dedf-4f7f-8ae5-6739fcd194d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:13.467061 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0582616b-dedf-4f7f-8ae5-6739fcd194d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:13.467831 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0582616b-dedf-4f7f-8ae5-6739fcd194d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:13.468267 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0582616b-dedf-4f7f-8ae5-6739fcd194d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:13.505314 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-34e40e48-a04b-433b-a10a-5f6c1af23173 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 38188 microversion: 2.20 time: 0.094195 Nov 08 16:16:13.506046 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 449/904] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:16:13 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 38188 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:16:13.552578 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0582616b-dedf-4f7f-8ae5-6739fcd194d9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 29413 microversion: 2.1 time: 0.097860 Nov 08 16:16:13.553275 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 456/905] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:16:13 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 29413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:16:14.564791 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-86f2d4f7-b545-42ba-b43a-52855bb1f82f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:14.566338 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-86f2d4f7-b545-42ba-b43a-52855bb1f82f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:14.573149 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-86f2d4f7-b545-42ba-b43a-52855bb1f82f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:14.573600 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-86f2d4f7-b545-42ba-b43a-52855bb1f82f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:14.574405 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-86f2d4f7-b545-42ba-b43a-52855bb1f82f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:14.574851 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-86f2d4f7-b545-42ba-b43a-52855bb1f82f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:14.690157 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-943fcb82-b69b-449e-b131-9c39dbe68298 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:14.691149 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-943fcb82-b69b-449e-b131-9c39dbe68298 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:14.697740 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-943fcb82-b69b-449e-b131-9c39dbe68298 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:14.698191 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-943fcb82-b69b-449e-b131-9c39dbe68298 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:14.698959 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-943fcb82-b69b-449e-b131-9c39dbe68298 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:14.699395 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-943fcb82-b69b-449e-b131-9c39dbe68298 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:16.941900 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-86f2d4f7-b545-42ba-b43a-52855bb1f82f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 33830 microversion: 2.1 time: 2.380404 Nov 08 16:16:16.942481 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 457/906] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:16:14 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 33830 bytes in 2383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:16:16.962009 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-943fcb82-b69b-449e-b131-9c39dbe68298 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 38188 microversion: 2.20 time: 2.449100 Nov 08 16:16:16.962621 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 450/907] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:16:14 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 38188 bytes in 2451 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:16:17.953486 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-be456b0f-ccc3-45b9-b095-0659e1b62dad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:17.954661 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-be456b0f-ccc3-45b9-b095-0659e1b62dad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:17.962628 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-be456b0f-ccc3-45b9-b095-0659e1b62dad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:17.963081 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-be456b0f-ccc3-45b9-b095-0659e1b62dad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:17.963890 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-be456b0f-ccc3-45b9-b095-0659e1b62dad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:17.964330 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-be456b0f-ccc3-45b9-b095-0659e1b62dad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:17.974873 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d093a068-d816-496b-a4ff-80cbe6e2c8de tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:17.976005 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d093a068-d816-496b-a4ff-80cbe6e2c8de tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:17.983526 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d093a068-d816-496b-a4ff-80cbe6e2c8de tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:17.983975 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d093a068-d816-496b-a4ff-80cbe6e2c8de tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:17.984749 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d093a068-d816-496b-a4ff-80cbe6e2c8de tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:17.985176 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d093a068-d816-496b-a4ff-80cbe6e2c8de tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:18.092514 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-be456b0f-ccc3-45b9-b095-0659e1b62dad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 35109 microversion: 2.1 time: 0.143246 Nov 08 16:16:18.093164 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 458/908] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:16:17 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 35109 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:16:18.154249 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d093a068-d816-496b-a4ff-80cbe6e2c8de tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 38188 microversion: 2.20 time: 0.183954 Nov 08 16:16:18.158253 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 451/909] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:16:17 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 38188 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:16:19.104973 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-6d40e53f-40ff-4715-ace1-460178070704 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:19.106785 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-6d40e53f-40ff-4715-ace1-460178070704 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:19.115560 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6d40e53f-40ff-4715-ace1-460178070704 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:19.116014 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6d40e53f-40ff-4715-ace1-460178070704 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:19.116778 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6d40e53f-40ff-4715-ace1-460178070704 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:19.117209 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6d40e53f-40ff-4715-ace1-460178070704 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:19.167075 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-902aa07c-a863-47ba-b13e-39ca301f0cc5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:19.168120 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-902aa07c-a863-47ba-b13e-39ca301f0cc5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:19.175720 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-902aa07c-a863-47ba-b13e-39ca301f0cc5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:19.176508 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-902aa07c-a863-47ba-b13e-39ca301f0cc5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:19.177291 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-902aa07c-a863-47ba-b13e-39ca301f0cc5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:19.177732 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-902aa07c-a863-47ba-b13e-39ca301f0cc5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:21.662386 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-6d40e53f-40ff-4715-ace1-460178070704 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 38131 microversion: 2.1 time: 2.561449 Nov 08 16:16:21.663906 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 459/910] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:16:19 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 38131 bytes in 2563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:16:21.689569 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-902aa07c-a863-47ba-b13e-39ca301f0cc5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 200 len: 38331 microversion: 2.20 time: 2.526303 Nov 08 16:16:21.690406 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 452/911] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:16:19 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 38331 bytes in 2528 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:16:21.700413 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9e810b34-f451-4f2d-99ae-11c87778ba00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:21.700987 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9e810b34-f451-4f2d-99ae-11c87778ba00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:21.708956 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9e810b34-f451-4f2d-99ae-11c87778ba00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:21.709403 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9e810b34-f451-4f2d-99ae-11c87778ba00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:21.710204 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9e810b34-f451-4f2d-99ae-11c87778ba00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:21.710638 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9e810b34-f451-4f2d-99ae-11c87778ba00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:21.733549 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9e810b34-f451-4f2d-99ae-11c87778ba00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/ips" status: 200 len: 152 microversion: 2.20 time: 0.037182 Nov 08 16:16:21.734144 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 460/912] 10.222.0.37 () {60 vars in 1288 bytes} [Mon Nov 8 16:16:21 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:16:22.674759 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d5d4d667-8d32-4feb-96eb-78383ed82bf9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:22.675845 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d5d4d667-8d32-4feb-96eb-78383ed82bf9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:22.683167 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5d4d667-8d32-4feb-96eb-78383ed82bf9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:22.683606 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5d4d667-8d32-4feb-96eb-78383ed82bf9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:22.684372 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5d4d667-8d32-4feb-96eb-78383ed82bf9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:22.684796 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5d4d667-8d32-4feb-96eb-78383ed82bf9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:22.760185 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d5d4d667-8d32-4feb-96eb-78383ed82bf9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 38133 microversion: 2.1 time: 0.089347 Nov 08 16:16:22.760822 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 453/913] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:16:22 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 38133 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:16:23.771557 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b0050ba5-925c-430a-9b29-2eec1dac530d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:23.772467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b0050ba5-925c-430a-9b29-2eec1dac530d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:23.778831 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b0050ba5-925c-430a-9b29-2eec1dac530d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:23.779265 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b0050ba5-925c-430a-9b29-2eec1dac530d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:23.780076 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b0050ba5-925c-430a-9b29-2eec1dac530d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:23.780507 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b0050ba5-925c-430a-9b29-2eec1dac530d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:23.860650 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b0050ba5-925c-430a-9b29-2eec1dac530d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 38133 microversion: 2.1 time: 0.092769 Nov 08 16:16:23.865141 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 461/914] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:16:23 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 38133 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:16:24.873407 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6cac0f5c-4ec2-4c3d-b769-88a5f161fdf5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:24.874496 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6cac0f5c-4ec2-4c3d-b769-88a5f161fdf5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:24.881989 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6cac0f5c-4ec2-4c3d-b769-88a5f161fdf5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:24.882426 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6cac0f5c-4ec2-4c3d-b769-88a5f161fdf5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:24.883184 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6cac0f5c-4ec2-4c3d-b769-88a5f161fdf5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:24.883608 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6cac0f5c-4ec2-4c3d-b769-88a5f161fdf5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:24.951137 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6cac0f5c-4ec2-4c3d-b769-88a5f161fdf5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 38133 microversion: 2.1 time: 0.082081 Nov 08 16:16:24.951777 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 454/915] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:16:24 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 38133 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:16:24.984088 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d7068a3c-c156-4caa-802a-64c431927e79 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:24.984820 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d7068a3c-c156-4caa-802a-64c431927e79 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:24.994013 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d7068a3c-c156-4caa-802a-64c431927e79 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:24.994462 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d7068a3c-c156-4caa-802a-64c431927e79 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:24.995317 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d7068a3c-c156-4caa-802a-64c431927e79 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:24.996796 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d7068a3c-c156-4caa-802a-64c431927e79 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:25.137980 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.objects.instance [None req-d7068a3c-c156-4caa-802a-64c431927e79 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lazy-loading 'services' on Instance uuid 116d828b-58e5-4928-bdf2-4f0f7cb4cd56 {{(pid=115524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:16:25.209796 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d7068a3c-c156-4caa-802a-64c431927e79 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "DELETE /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56/os-volume_attachments/1df123e2-4b89-4705-ad0d-2057e3da640b" status: 202 len: 0 microversion: 2.1 time: 0.231819 Nov 08 16:16:25.212083 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 462/916] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Nov 8 16:16:24 2021] DELETE /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56/os-volume_attachments/1df123e2-4b89-4705-ad0d-2057e3da640b => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:16:25.306567 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1d9a1d85-b273-478f-8a3c-914dac7ed187 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:25.307251 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1d9a1d85-b273-478f-8a3c-914dac7ed187 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:25.314744 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1d9a1d85-b273-478f-8a3c-914dac7ed187 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:25.315251 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1d9a1d85-b273-478f-8a3c-914dac7ed187 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:25.316318 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1d9a1d85-b273-478f-8a3c-914dac7ed187 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:25.316861 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1d9a1d85-b273-478f-8a3c-914dac7ed187 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:25.342978 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.objects.instance [None req-1d9a1d85-b273-478f-8a3c-914dac7ed187 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lazy-loading 'flavor' on Instance uuid 1c1c8c8d-5f78-45fb-803d-8f7a84df3433 {{(pid=115523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:16:25.729243 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1d9a1d85-b273-478f-8a3c-914dac7ed187 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 202 len: 0 microversion: 2.20 time: 0.426700 Nov 08 16:16:25.730049 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 455/917] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:16:25 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:16:25.739766 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a16a805f-720b-4014-ab14-c8a199987218 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:25.740386 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a16a805f-720b-4014-ab14-c8a199987218 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:25.747734 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a16a805f-720b-4014-ab14-c8a199987218 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:25.748246 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a16a805f-720b-4014-ab14-c8a199987218 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:25.748969 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a16a805f-720b-4014-ab14-c8a199987218 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:25.749407 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a16a805f-720b-4014-ab14-c8a199987218 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:25.989060 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a16a805f-720b-4014-ab14-c8a199987218 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:26.002402 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a16a805f-720b-4014-ab14-c8a199987218 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:26.004945 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a16a805f-720b-4014-ab14-c8a199987218 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:26.007298 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a16a805f-720b-4014-ab14-c8a199987218 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.272724 Nov 08 16:16:26.018999 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 463/918] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:25 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:26.231769 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-17e61e80-3473-40ff-b384-5a250c6490a0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:26.252216 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-17e61e80-3473-40ff-b384-5a250c6490a0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:26.279400 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-17e61e80-3473-40ff-b384-5a250c6490a0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:26.279846 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-17e61e80-3473-40ff-b384-5a250c6490a0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:26.280637 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-17e61e80-3473-40ff-b384-5a250c6490a0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:26.281084 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-17e61e80-3473-40ff-b384-5a250c6490a0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:26.351054 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ef373cd0-4c31-4d40-b7a6-173208bcbca0 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:26.352290 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ef373cd0-4c31-4d40-b7a6-173208bcbca0 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:26.359565 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ef373cd0-4c31-4d40-b7a6-173208bcbca0 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:26.360157 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ef373cd0-4c31-4d40-b7a6-173208bcbca0 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:26.363367 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ef373cd0-4c31-4d40-b7a6-173208bcbca0 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:26.364218 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ef373cd0-4c31-4d40-b7a6-173208bcbca0 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:26.386586 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-17e61e80-3473-40ff-b384-5a250c6490a0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 200 len: 38262 microversion: 2.1 time: 0.421250 Nov 08 16:16:26.387369 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 456/919] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:16:25 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 38262 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:16:26.399106 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b7621740-1ba7-4362-9fb9-55ca77f703c1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:26.399689 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b7621740-1ba7-4362-9fb9-55ca77f703c1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:26.411430 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b7621740-1ba7-4362-9fb9-55ca77f703c1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:26.411871 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b7621740-1ba7-4362-9fb9-55ca77f703c1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:26.413945 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b7621740-1ba7-4362-9fb9-55ca77f703c1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:26.414426 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b7621740-1ba7-4362-9fb9-55ca77f703c1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:26.415221 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ef373cd0-4c31-4d40-b7a6-173208bcbca0 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Going to try to terminate instance {{(pid=115524) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:16:26.442362 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b7621740-1ba7-4362-9fb9-55ca77f703c1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/ips" status: 200 len: 144 microversion: 2.1 time: 0.048089 Nov 08 16:16:26.443159 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 457/920] 10.222.0.37 () {58 vars in 1247 bytes} [Mon Nov 8 16:16:26 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/ips => generated 144 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:16:26.536498 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ef373cd0-4c31-4d40-b7a6-173208bcbca0 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "DELETE /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56" status: 204 len: 0 microversion: 2.1 time: 0.186600 Nov 08 16:16:26.538572 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 464/921] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:16:26 2021] DELETE /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 08 16:16:26.550102 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-88a814b0-5b34-4f96-952b-463e40bb3a9a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:26.550874 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-88a814b0-5b34-4f96-952b-463e40bb3a9a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:26.564972 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-88a814b0-5b34-4f96-952b-463e40bb3a9a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:26.566041 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-88a814b0-5b34-4f96-952b-463e40bb3a9a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:26.567519 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-88a814b0-5b34-4f96-952b-463e40bb3a9a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:26.568078 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-88a814b0-5b34-4f96-952b-463e40bb3a9a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:26.742562 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-88a814b0-5b34-4f96-952b-463e40bb3a9a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:26.751382 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-88a814b0-5b34-4f96-952b-463e40bb3a9a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56" status: 200 len: 1514 microversion: 2.1 time: 0.208179 Nov 08 16:16:26.762019 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 458/922] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:26 2021] GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56 => generated 1514 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:16:27.026956 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1b6c57c4-e14a-406f-a679-c473b59b2f2d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:27.027714 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1b6c57c4-e14a-406f-a679-c473b59b2f2d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:27.034760 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1b6c57c4-e14a-406f-a679-c473b59b2f2d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:27.035967 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1b6c57c4-e14a-406f-a679-c473b59b2f2d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:27.036817 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1b6c57c4-e14a-406f-a679-c473b59b2f2d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:27.037453 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1b6c57c4-e14a-406f-a679-c473b59b2f2d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:27.242193 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1b6c57c4-e14a-406f-a679-c473b59b2f2d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:27.251060 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1b6c57c4-e14a-406f-a679-c473b59b2f2d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:27.253254 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1b6c57c4-e14a-406f-a679-c473b59b2f2d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:27.254810 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1b6c57c4-e14a-406f-a679-c473b59b2f2d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.232417 Nov 08 16:16:27.255462 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 465/923] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:27 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:27.769435 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9fae1770-79fc-4978-85ef-16be2b378f47 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:27.770069 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-9fae1770-79fc-4978-85ef-16be2b378f47 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:27.778690 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9fae1770-79fc-4978-85ef-16be2b378f47 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:27.779425 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9fae1770-79fc-4978-85ef-16be2b378f47 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:27.781238 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9fae1770-79fc-4978-85ef-16be2b378f47 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:27.782026 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9fae1770-79fc-4978-85ef-16be2b378f47 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:28.033364 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-9fae1770-79fc-4978-85ef-16be2b378f47 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:28.044684 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-9fae1770-79fc-4978-85ef-16be2b378f47 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56" status: 200 len: 1514 microversion: 2.1 time: 0.280032 Nov 08 16:16:28.045437 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 459/924] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:27 2021] GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56 => generated 1514 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:16:28.272639 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2b49dad7-59df-40b8-af96-ea31b086c154 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:28.273341 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2b49dad7-59df-40b8-af96-ea31b086c154 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:28.279524 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2b49dad7-59df-40b8-af96-ea31b086c154 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:28.279966 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2b49dad7-59df-40b8-af96-ea31b086c154 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:28.280780 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2b49dad7-59df-40b8-af96-ea31b086c154 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:28.281144 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2b49dad7-59df-40b8-af96-ea31b086c154 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:28.418838 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-2b49dad7-59df-40b8-af96-ea31b086c154 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:28.426632 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-2b49dad7-59df-40b8-af96-ea31b086c154 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:28.428143 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-2b49dad7-59df-40b8-af96-ea31b086c154 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:28.429314 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2b49dad7-59df-40b8-af96-ea31b086c154 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.160771 Nov 08 16:16:28.429898 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 466/925] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:28 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:29.046349 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6b8647e8-7715-4f7f-a874-869045a12b57 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29ed27a2-68df-4377-8ed6-55363d46dfbc"}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:29.047610 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6b8647e8-7715-4f7f-a874-869045a12b57 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:29.054617 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6b8647e8-7715-4f7f-a874-869045a12b57 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:29.055257 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6b8647e8-7715-4f7f-a874-869045a12b57 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:29.056034 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6b8647e8-7715-4f7f-a874-869045a12b57 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:29.056635 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6b8647e8-7715-4f7f-a874-869045a12b57 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:29.062294 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2abf88f1-3cd3-43e9-b02e-47104d7f7712 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:29.063026 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2abf88f1-3cd3-43e9-b02e-47104d7f7712 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:29.071801 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2abf88f1-3cd3-43e9-b02e-47104d7f7712 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:29.071801 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2abf88f1-3cd3-43e9-b02e-47104d7f7712 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:29.072207 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2abf88f1-3cd3-43e9-b02e-47104d7f7712 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:29.072778 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2abf88f1-3cd3-43e9-b02e-47104d7f7712 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:29.333092 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-2abf88f1-3cd3-43e9-b02e-47104d7f7712 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ef1300b67b41d5a67626dc96347ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e827086bb348d190546b9a0c0ba087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:29.341192 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2abf88f1-3cd3-43e9-b02e-47104d7f7712 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56" status: 200 len: 1514 microversion: 2.1 time: 0.282386 Nov 08 16:16:29.343824 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6b8647e8-7715-4f7f-a874-869045a12b57 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300459 Nov 08 16:16:29.344651 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 460/926] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Nov 8 16:16:29 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:16:29.355085 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 467/927] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:29 2021] GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56 => generated 1514 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:16:29.447615 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-fbba94a6-990a-4712-8cbe-2f714f86d4b9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:29.449062 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fbba94a6-990a-4712-8cbe-2f714f86d4b9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:29.456059 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fbba94a6-990a-4712-8cbe-2f714f86d4b9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:29.456529 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fbba94a6-990a-4712-8cbe-2f714f86d4b9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:29.457304 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fbba94a6-990a-4712-8cbe-2f714f86d4b9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:29.457754 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fbba94a6-990a-4712-8cbe-2f714f86d4b9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:29.614816 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-06786af6-39bb-4476-9d24-d6aed5277f42 req-2453c89a-e7d3-464a-acd1-eec5a53a357f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "116d828b-58e5-4928-bdf2-4f0f7cb4cd56", "name": "network-vif-deleted", "tag": "f510df50-3aa6-4a56-a3f6-1075cc078430"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:29.616561 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:16:29.616561 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:16:29.626486 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-06786af6-39bb-4476-9d24-d6aed5277f42 req-2453c89a-e7d3-464a-acd1-eec5a53a357f service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:29.626873 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-06786af6-39bb-4476-9d24-d6aed5277f42 req-2453c89a-e7d3-464a-acd1-eec5a53a357f service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:29.642266 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-06786af6-39bb-4476-9d24-d6aed5277f42 req-2453c89a-e7d3-464a-acd1-eec5a53a357f service nova] Creating event network-vif-deleted:f510df50-3aa6-4a56-a3f6-1075cc078430 for instance 116d828b-58e5-4928-bdf2-4f0f7cb4cd56 on hv-cinder-81618 Nov 08 16:16:29.654687 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-06786af6-39bb-4476-9d24-d6aed5277f42 req-2453c89a-e7d3-464a-acd1-eec5a53a357f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040001 Nov 08 16:16:29.655406 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 468/928] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:16:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:16:29.690270 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fbba94a6-990a-4712-8cbe-2f714f86d4b9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:29.697897 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fbba94a6-990a-4712-8cbe-2f714f86d4b9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:29.699390 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fbba94a6-990a-4712-8cbe-2f714f86d4b9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:29.700542 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-fbba94a6-990a-4712-8cbe-2f714f86d4b9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.256934 Nov 08 16:16:29.701095 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 461/929] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:29 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:30.359101 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9c58207d-fe33-470d-a1f0-f0896d16da07 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:30.359826 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9c58207d-fe33-470d-a1f0-f0896d16da07 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] [instance: 116d828b-58e5-4928-bdf2-4f0f7cb4cd56] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:30.366533 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9c58207d-fe33-470d-a1f0-f0896d16da07 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:30.366984 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9c58207d-fe33-470d-a1f0-f0896d16da07 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:30.367763 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9c58207d-fe33-470d-a1f0-f0896d16da07 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:30.368195 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9c58207d-fe33-470d-a1f0-f0896d16da07 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:30.381816 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-9c58207d-fe33-470d-a1f0-f0896d16da07 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] HTTP exception thrown: Instance 116d828b-58e5-4928-bdf2-4f0f7cb4cd56 could not be found. Nov 08 16:16:30.382403 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9c58207d-fe33-470d-a1f0-f0896d16da07 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Returning 404 to user: Instance 116d828b-58e5-4928-bdf2-4f0f7cb4cd56 could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:16:30.383220 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9c58207d-fe33-470d-a1f0-f0896d16da07 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56" status: 404 len: 111 microversion: 2.1 time: 0.028356 Nov 08 16:16:30.383751 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 469/930] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:30 2021] GET /compute/v2.1/servers/116d828b-58e5-4928-bdf2-4f0f7cb4cd56 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:16:30.718829 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-df68f0af-e7aa-4952-8258-42d4502bd4ea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:30.719362 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-df68f0af-e7aa-4952-8258-42d4502bd4ea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:30.726563 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-df68f0af-e7aa-4952-8258-42d4502bd4ea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:30.727038 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-df68f0af-e7aa-4952-8258-42d4502bd4ea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:30.727832 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-df68f0af-e7aa-4952-8258-42d4502bd4ea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:30.728264 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-df68f0af-e7aa-4952-8258-42d4502bd4ea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:30.855822 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-df68f0af-e7aa-4952-8258-42d4502bd4ea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:30.863972 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-df68f0af-e7aa-4952-8258-42d4502bd4ea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:30.865446 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-df68f0af-e7aa-4952-8258-42d4502bd4ea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:30.866613 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-df68f0af-e7aa-4952-8258-42d4502bd4ea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.151902 Nov 08 16:16:30.867154 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 462/931] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:30 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:31.884308 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-782f97b1-f8f1-412c-b0bc-007e4b1effd6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:31.884908 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-782f97b1-f8f1-412c-b0bc-007e4b1effd6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:31.891062 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-782f97b1-f8f1-412c-b0bc-007e4b1effd6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:31.891503 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-782f97b1-f8f1-412c-b0bc-007e4b1effd6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:31.892259 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-782f97b1-f8f1-412c-b0bc-007e4b1effd6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:31.892684 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-782f97b1-f8f1-412c-b0bc-007e4b1effd6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:32.023822 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-782f97b1-f8f1-412c-b0bc-007e4b1effd6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:32.031522 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-782f97b1-f8f1-412c-b0bc-007e4b1effd6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:32.033014 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-782f97b1-f8f1-412c-b0bc-007e4b1effd6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:32.034185 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-782f97b1-f8f1-412c-b0bc-007e4b1effd6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.153499 Nov 08 16:16:32.034740 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 470/932] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:31 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:33.051817 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-950f2057-ea5d-46f0-8f15-da44621a7cea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:33.052436 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-950f2057-ea5d-46f0-8f15-da44621a7cea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:33.058646 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-950f2057-ea5d-46f0-8f15-da44621a7cea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:33.059094 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-950f2057-ea5d-46f0-8f15-da44621a7cea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:33.059891 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-950f2057-ea5d-46f0-8f15-da44621a7cea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:33.060319 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-950f2057-ea5d-46f0-8f15-da44621a7cea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:33.199569 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-950f2057-ea5d-46f0-8f15-da44621a7cea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:33.207967 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-950f2057-ea5d-46f0-8f15-da44621a7cea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:33.209466 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-950f2057-ea5d-46f0-8f15-da44621a7cea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:33.210662 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-950f2057-ea5d-46f0-8f15-da44621a7cea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.162459 Nov 08 16:16:33.211220 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 463/933] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:33 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:34.227969 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-33ea893c-8d4a-477d-be08-c3247513295b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:34.228580 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-33ea893c-8d4a-477d-be08-c3247513295b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:34.235062 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-33ea893c-8d4a-477d-be08-c3247513295b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:34.235534 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-33ea893c-8d4a-477d-be08-c3247513295b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:34.236333 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-33ea893c-8d4a-477d-be08-c3247513295b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:34.237647 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-33ea893c-8d4a-477d-be08-c3247513295b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:34.369981 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-33ea893c-8d4a-477d-be08-c3247513295b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:34.378471 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-33ea893c-8d4a-477d-be08-c3247513295b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:34.379963 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-33ea893c-8d4a-477d-be08-c3247513295b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:34.381108 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-33ea893c-8d4a-477d-be08-c3247513295b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.156883 Nov 08 16:16:34.381867 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 471/934] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:34 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:35.399731 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-39f46e8e-7c1c-44b1-8d37-972967610801 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:35.400333 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-39f46e8e-7c1c-44b1-8d37-972967610801 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:35.406468 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-39f46e8e-7c1c-44b1-8d37-972967610801 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:35.407172 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-39f46e8e-7c1c-44b1-8d37-972967610801 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:35.407591 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-39f46e8e-7c1c-44b1-8d37-972967610801 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:35.408018 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-39f46e8e-7c1c-44b1-8d37-972967610801 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:35.539664 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-39f46e8e-7c1c-44b1-8d37-972967610801 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:35.547340 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-39f46e8e-7c1c-44b1-8d37-972967610801 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:35.548828 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-39f46e8e-7c1c-44b1-8d37-972967610801 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:35.550004 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-39f46e8e-7c1c-44b1-8d37-972967610801 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.153997 Nov 08 16:16:35.550561 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 464/935] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:35 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:36.568503 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7bf06c88-6752-497b-b5bd-e5313c38988a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:36.569035 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7bf06c88-6752-497b-b5bd-e5313c38988a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:36.575305 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7bf06c88-6752-497b-b5bd-e5313c38988a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:36.575751 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7bf06c88-6752-497b-b5bd-e5313c38988a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:36.576523 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7bf06c88-6752-497b-b5bd-e5313c38988a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:36.576959 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7bf06c88-6752-497b-b5bd-e5313c38988a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:36.700961 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7bf06c88-6752-497b-b5bd-e5313c38988a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:36.708600 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7bf06c88-6752-497b-b5bd-e5313c38988a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:36.710127 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7bf06c88-6752-497b-b5bd-e5313c38988a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:36.711265 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7bf06c88-6752-497b-b5bd-e5313c38988a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.147145 Nov 08 16:16:36.711809 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 472/936] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:36 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:37.729267 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6e897d78-cec0-43fd-aea3-636394bfd158 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:37.729810 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6e897d78-cec0-43fd-aea3-636394bfd158 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:37.736000 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6e897d78-cec0-43fd-aea3-636394bfd158 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:37.736448 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6e897d78-cec0-43fd-aea3-636394bfd158 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:37.737792 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6e897d78-cec0-43fd-aea3-636394bfd158 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:37.738225 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6e897d78-cec0-43fd-aea3-636394bfd158 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:37.864134 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6e897d78-cec0-43fd-aea3-636394bfd158 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:37.872001 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6e897d78-cec0-43fd-aea3-636394bfd158 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:37.873490 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6e897d78-cec0-43fd-aea3-636394bfd158 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:37.874672 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6e897d78-cec0-43fd-aea3-636394bfd158 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.149162 Nov 08 16:16:37.875257 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 465/937] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:37 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:38.892245 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0ef0905f-b177-4954-aa68-cba4c6af124a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:38.892874 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0ef0905f-b177-4954-aa68-cba4c6af124a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:38.899676 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0ef0905f-b177-4954-aa68-cba4c6af124a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:38.900123 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0ef0905f-b177-4954-aa68-cba4c6af124a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:38.900895 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0ef0905f-b177-4954-aa68-cba4c6af124a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:38.901331 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0ef0905f-b177-4954-aa68-cba4c6af124a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:39.030562 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0ef0905f-b177-4954-aa68-cba4c6af124a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:39.038717 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0ef0905f-b177-4954-aa68-cba4c6af124a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:39.040482 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0ef0905f-b177-4954-aa68-cba4c6af124a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:39.041651 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0ef0905f-b177-4954-aa68-cba4c6af124a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.153252 Nov 08 16:16:39.042217 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 473/938] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:38 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:39.967902 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a119c688-36f6-457f-8847-318c56a30cac tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:39.975015 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a119c688-36f6-457f-8847-318c56a30cac tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:39.975508 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a119c688-36f6-457f-8847-318c56a30cac tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:40.034136 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a119c688-36f6-457f-8847-318c56a30cac tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Going to try to stop instance {{(pid=115523) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 08 16:16:40.059406 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-afc3cac6-ec46-4da8-b7c5-c2c5b33a41d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:40.060064 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-afc3cac6-ec46-4da8-b7c5-c2c5b33a41d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:40.067603 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-afc3cac6-ec46-4da8-b7c5-c2c5b33a41d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:40.068055 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-afc3cac6-ec46-4da8-b7c5-c2c5b33a41d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:40.069043 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-afc3cac6-ec46-4da8-b7c5-c2c5b33a41d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:40.069458 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-afc3cac6-ec46-4da8-b7c5-c2c5b33a41d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:40.083511 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a119c688-36f6-457f-8847-318c56a30cac tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 202 len: 0 microversion: 2.1 time: 0.114492 Nov 08 16:16:40.083511 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 466/939] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:16:39 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:16:40.088594 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-824f9531-e35d-433c-8962-309b34fa1adc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:40.089454 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-824f9531-e35d-433c-8962-309b34fa1adc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:40.096556 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-824f9531-e35d-433c-8962-309b34fa1adc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:40.097006 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-824f9531-e35d-433c-8962-309b34fa1adc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:40.098023 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-824f9531-e35d-433c-8962-309b34fa1adc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:40.098312 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-824f9531-e35d-433c-8962-309b34fa1adc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:40.240705 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-afc3cac6-ec46-4da8-b7c5-c2c5b33a41d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:40.249592 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-afc3cac6-ec46-4da8-b7c5-c2c5b33a41d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:40.251547 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-afc3cac6-ec46-4da8-b7c5-c2c5b33a41d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:40.253456 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-afc3cac6-ec46-4da8-b7c5-c2c5b33a41d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.197872 Nov 08 16:16:40.254508 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 474/940] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:40 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:16:40.289341 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-824f9531-e35d-433c-8962-309b34fa1adc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:40.296916 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-824f9531-e35d-433c-8962-309b34fa1adc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1721 microversion: 2.1 time: 0.212553 Nov 08 16:16:40.297481 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 467/941] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:40 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:16:41.271143 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-581cdf15-0e9d-4f33-a4ae-d9354fde5e59 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:41.271741 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-581cdf15-0e9d-4f33-a4ae-d9354fde5e59 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:41.278205 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-581cdf15-0e9d-4f33-a4ae-d9354fde5e59 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:41.278653 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-581cdf15-0e9d-4f33-a4ae-d9354fde5e59 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:41.279426 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-581cdf15-0e9d-4f33-a4ae-d9354fde5e59 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:41.279859 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-581cdf15-0e9d-4f33-a4ae-d9354fde5e59 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:41.313855 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b250e367-1159-45cf-83a8-18b140070d46 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:41.314452 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b250e367-1159-45cf-83a8-18b140070d46 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:41.321147 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b250e367-1159-45cf-83a8-18b140070d46 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:41.321586 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b250e367-1159-45cf-83a8-18b140070d46 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:41.322395 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b250e367-1159-45cf-83a8-18b140070d46 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:41.322820 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b250e367-1159-45cf-83a8-18b140070d46 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:41.449409 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-581cdf15-0e9d-4f33-a4ae-d9354fde5e59 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:41.464866 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-581cdf15-0e9d-4f33-a4ae-d9354fde5e59 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:41.466880 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-581cdf15-0e9d-4f33-a4ae-d9354fde5e59 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:41.468358 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-581cdf15-0e9d-4f33-a4ae-d9354fde5e59 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.201421 Nov 08 16:16:41.469922 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 475/942] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:41 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:41.530555 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b250e367-1159-45cf-83a8-18b140070d46 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:41.541461 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b250e367-1159-45cf-83a8-18b140070d46 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1721 microversion: 2.1 time: 0.230878 Nov 08 16:16:41.542067 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 468/943] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:41 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:16:42.487267 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c9834021-36e3-4c70-b7d8-f2b55df3d035 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:42.487781 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c9834021-36e3-4c70-b7d8-f2b55df3d035 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:42.494126 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c9834021-36e3-4c70-b7d8-f2b55df3d035 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:42.494575 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c9834021-36e3-4c70-b7d8-f2b55df3d035 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:42.495342 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c9834021-36e3-4c70-b7d8-f2b55df3d035 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:42.496043 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c9834021-36e3-4c70-b7d8-f2b55df3d035 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:42.565782 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8e39e05b-01c2-4e08-979b-7069b1e38327 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:42.567525 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8e39e05b-01c2-4e08-979b-7069b1e38327 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:42.573930 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8e39e05b-01c2-4e08-979b-7069b1e38327 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:42.574361 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8e39e05b-01c2-4e08-979b-7069b1e38327 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:42.575170 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8e39e05b-01c2-4e08-979b-7069b1e38327 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:42.575597 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8e39e05b-01c2-4e08-979b-7069b1e38327 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:42.650249 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c9834021-36e3-4c70-b7d8-f2b55df3d035 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:42.658185 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c9834021-36e3-4c70-b7d8-f2b55df3d035 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:42.659688 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c9834021-36e3-4c70-b7d8-f2b55df3d035 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:42.660840 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c9834021-36e3-4c70-b7d8-f2b55df3d035 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.177323 Nov 08 16:16:42.661596 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 476/944] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:42 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:42.717592 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8e39e05b-01c2-4e08-979b-7069b1e38327 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:42.725148 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8e39e05b-01c2-4e08-979b-7069b1e38327 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1721 microversion: 2.1 time: 0.170120 Nov 08 16:16:42.725722 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 469/945] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:42 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:16:43.678875 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1c54d0b3-09d6-4303-a701-cef99fbc39ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:43.679512 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1c54d0b3-09d6-4303-a701-cef99fbc39ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:43.686017 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1c54d0b3-09d6-4303-a701-cef99fbc39ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:43.686467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1c54d0b3-09d6-4303-a701-cef99fbc39ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:43.687253 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1c54d0b3-09d6-4303-a701-cef99fbc39ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:43.687698 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1c54d0b3-09d6-4303-a701-cef99fbc39ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:43.743703 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-92609bca-8059-4684-8644-b7e15c0b725a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:43.744758 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-92609bca-8059-4684-8644-b7e15c0b725a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:43.752671 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-92609bca-8059-4684-8644-b7e15c0b725a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:43.753319 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-92609bca-8059-4684-8644-b7e15c0b725a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:43.754142 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-92609bca-8059-4684-8644-b7e15c0b725a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:43.754580 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-92609bca-8059-4684-8644-b7e15c0b725a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:43.861961 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1c54d0b3-09d6-4303-a701-cef99fbc39ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:43.870548 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1c54d0b3-09d6-4303-a701-cef99fbc39ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:43.872321 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1c54d0b3-09d6-4303-a701-cef99fbc39ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:43.873476 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1c54d0b3-09d6-4303-a701-cef99fbc39ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.198973 Nov 08 16:16:43.874077 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 477/946] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:43 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:43.928260 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-92609bca-8059-4684-8644-b7e15c0b725a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:43.936763 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-92609bca-8059-4684-8644-b7e15c0b725a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1721 microversion: 2.1 time: 0.197709 Nov 08 16:16:43.937330 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 470/947] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:43 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:16:44.891070 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bcb80a10-5e2e-4d5c-b922-2bdba68bd01b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:44.891702 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-bcb80a10-5e2e-4d5c-b922-2bdba68bd01b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:44.898952 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bcb80a10-5e2e-4d5c-b922-2bdba68bd01b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:44.899401 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bcb80a10-5e2e-4d5c-b922-2bdba68bd01b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:44.900181 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bcb80a10-5e2e-4d5c-b922-2bdba68bd01b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:44.900613 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bcb80a10-5e2e-4d5c-b922-2bdba68bd01b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:44.953851 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-420b1a8c-ce21-4075-8dff-b5277bd34dde tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:44.954579 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-420b1a8c-ce21-4075-8dff-b5277bd34dde tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:44.961494 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-420b1a8c-ce21-4075-8dff-b5277bd34dde tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:44.961922 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-420b1a8c-ce21-4075-8dff-b5277bd34dde tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:44.962676 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-420b1a8c-ce21-4075-8dff-b5277bd34dde tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:44.963107 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-420b1a8c-ce21-4075-8dff-b5277bd34dde tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:45.076973 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-bcb80a10-5e2e-4d5c-b922-2bdba68bd01b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:45.091627 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-bcb80a10-5e2e-4d5c-b922-2bdba68bd01b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:45.093877 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-bcb80a10-5e2e-4d5c-b922-2bdba68bd01b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:45.096614 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bcb80a10-5e2e-4d5c-b922-2bdba68bd01b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.209343 Nov 08 16:16:45.098305 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 478/948] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:44 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:45.169915 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-420b1a8c-ce21-4075-8dff-b5277bd34dde tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:45.178679 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-420b1a8c-ce21-4075-8dff-b5277bd34dde tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1721 microversion: 2.1 time: 0.228515 Nov 08 16:16:45.179248 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 471/949] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:44 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:16:46.116487 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-757d014b-fb31-420d-aa4f-ddac68b456f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:46.117133 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-757d014b-fb31-420d-aa4f-ddac68b456f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:46.128532 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-757d014b-fb31-420d-aa4f-ddac68b456f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:46.129630 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-757d014b-fb31-420d-aa4f-ddac68b456f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:46.130618 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-757d014b-fb31-420d-aa4f-ddac68b456f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:46.131221 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-757d014b-fb31-420d-aa4f-ddac68b456f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:46.196608 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-64357632-4615-49d5-9dc3-291afca24ac9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:46.198030 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-64357632-4615-49d5-9dc3-291afca24ac9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:46.206574 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-64357632-4615-49d5-9dc3-291afca24ac9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:46.207891 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-64357632-4615-49d5-9dc3-291afca24ac9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:46.210109 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-64357632-4615-49d5-9dc3-291afca24ac9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:46.211042 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-64357632-4615-49d5-9dc3-291afca24ac9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:46.306828 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-757d014b-fb31-420d-aa4f-ddac68b456f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:46.316430 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-757d014b-fb31-420d-aa4f-ddac68b456f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:46.318216 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-757d014b-fb31-420d-aa4f-ddac68b456f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:46.319592 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-757d014b-fb31-420d-aa4f-ddac68b456f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.207087 Nov 08 16:16:46.320434 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 479/950] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:46 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:46.386899 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-64357632-4615-49d5-9dc3-291afca24ac9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:46.395247 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-64357632-4615-49d5-9dc3-291afca24ac9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1721 microversion: 2.1 time: 0.203173 Nov 08 16:16:46.396210 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 472/951] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:46 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:16:47.338925 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b1a1cb49-1f7f-4fbf-8dd7-6b6948851fe6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:47.339625 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b1a1cb49-1f7f-4fbf-8dd7-6b6948851fe6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:47.346137 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b1a1cb49-1f7f-4fbf-8dd7-6b6948851fe6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:47.346774 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b1a1cb49-1f7f-4fbf-8dd7-6b6948851fe6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:47.347720 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b1a1cb49-1f7f-4fbf-8dd7-6b6948851fe6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:47.348315 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b1a1cb49-1f7f-4fbf-8dd7-6b6948851fe6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:47.414676 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-73a660d3-e777-4db1-adb9-365a18a0af57 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:47.416205 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-73a660d3-e777-4db1-adb9-365a18a0af57 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:47.423805 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-73a660d3-e777-4db1-adb9-365a18a0af57 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:47.424963 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-73a660d3-e777-4db1-adb9-365a18a0af57 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:47.425812 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-73a660d3-e777-4db1-adb9-365a18a0af57 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:47.426798 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-73a660d3-e777-4db1-adb9-365a18a0af57 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:47.536524 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b1a1cb49-1f7f-4fbf-8dd7-6b6948851fe6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:47.545140 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b1a1cb49-1f7f-4fbf-8dd7-6b6948851fe6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:47.546757 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b1a1cb49-1f7f-4fbf-8dd7-6b6948851fe6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:47.548017 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b1a1cb49-1f7f-4fbf-8dd7-6b6948851fe6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.213006 Nov 08 16:16:47.548669 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 480/952] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:47 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:47.597930 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-73a660d3-e777-4db1-adb9-365a18a0af57 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:47.605996 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-73a660d3-e777-4db1-adb9-365a18a0af57 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1721 microversion: 2.1 time: 0.196067 Nov 08 16:16:47.606563 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 473/953] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:47 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:16:48.567358 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-11856f7a-3976-44ff-a0c9-6caf689667a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:48.567967 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-11856f7a-3976-44ff-a0c9-6caf689667a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:48.574212 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-11856f7a-3976-44ff-a0c9-6caf689667a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:48.574667 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-11856f7a-3976-44ff-a0c9-6caf689667a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:48.575443 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-11856f7a-3976-44ff-a0c9-6caf689667a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:48.575882 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-11856f7a-3976-44ff-a0c9-6caf689667a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:48.623546 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-53b9884b-eebe-4abf-9ccf-a88d26d9a704 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:48.624106 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-53b9884b-eebe-4abf-9ccf-a88d26d9a704 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:48.631174 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-53b9884b-eebe-4abf-9ccf-a88d26d9a704 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:48.633445 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-53b9884b-eebe-4abf-9ccf-a88d26d9a704 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:48.634795 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-53b9884b-eebe-4abf-9ccf-a88d26d9a704 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:48.635231 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-53b9884b-eebe-4abf-9ccf-a88d26d9a704 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:48.746547 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-11856f7a-3976-44ff-a0c9-6caf689667a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:48.755393 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-11856f7a-3976-44ff-a0c9-6caf689667a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:48.756909 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-11856f7a-3976-44ff-a0c9-6caf689667a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:48.758103 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-11856f7a-3976-44ff-a0c9-6caf689667a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.195002 Nov 08 16:16:48.758671 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 481/954] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:48 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:48.817495 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-53b9884b-eebe-4abf-9ccf-a88d26d9a704 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:48.825055 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-53b9884b-eebe-4abf-9ccf-a88d26d9a704 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1721 microversion: 2.1 time: 0.205319 Nov 08 16:16:48.825613 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 474/955] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:48 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:16:49.776182 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-caa2f2ee-184a-4213-ba31-443f8d1f024b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:49.776779 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-caa2f2ee-184a-4213-ba31-443f8d1f024b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:49.782894 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-caa2f2ee-184a-4213-ba31-443f8d1f024b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:49.783964 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-caa2f2ee-184a-4213-ba31-443f8d1f024b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:49.784722 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-caa2f2ee-184a-4213-ba31-443f8d1f024b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:49.785152 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-caa2f2ee-184a-4213-ba31-443f8d1f024b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:49.842904 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4dd20327-5d01-4e68-9fd3-3c2701c35012 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:49.843508 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4dd20327-5d01-4e68-9fd3-3c2701c35012 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:49.850309 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4dd20327-5d01-4e68-9fd3-3c2701c35012 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:49.850753 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4dd20327-5d01-4e68-9fd3-3c2701c35012 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:49.851523 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4dd20327-5d01-4e68-9fd3-3c2701c35012 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:49.851952 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4dd20327-5d01-4e68-9fd3-3c2701c35012 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:49.942838 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-caa2f2ee-184a-4213-ba31-443f8d1f024b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:49.950437 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-caa2f2ee-184a-4213-ba31-443f8d1f024b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:49.951922 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-caa2f2ee-184a-4213-ba31-443f8d1f024b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:49.953228 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-caa2f2ee-184a-4213-ba31-443f8d1f024b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.180781 Nov 08 16:16:49.953919 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 482/956] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:49 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:50.003007 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4dd20327-5d01-4e68-9fd3-3c2701c35012 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:50.010642 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4dd20327-5d01-4e68-9fd3-3c2701c35012 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1721 microversion: 2.1 time: 0.171480 Nov 08 16:16:50.011203 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 475/957] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:49 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:16:50.979332 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-760592b7-faf7-4ee2-9877-f757db139ea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:50.980852 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-760592b7-faf7-4ee2-9877-f757db139ea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:50.992763 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-760592b7-faf7-4ee2-9877-f757db139ea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:50.993415 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-760592b7-faf7-4ee2-9877-f757db139ea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:50.994290 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-760592b7-faf7-4ee2-9877-f757db139ea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:50.995065 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-760592b7-faf7-4ee2-9877-f757db139ea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:51.029206 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-cd82ec11-0f9f-4087-9eee-23f68acf4a64 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:51.030568 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-cd82ec11-0f9f-4087-9eee-23f68acf4a64 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:51.037403 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cd82ec11-0f9f-4087-9eee-23f68acf4a64 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:51.038292 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cd82ec11-0f9f-4087-9eee-23f68acf4a64 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:51.039510 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cd82ec11-0f9f-4087-9eee-23f68acf4a64 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:51.040437 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cd82ec11-0f9f-4087-9eee-23f68acf4a64 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:51.176712 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-760592b7-faf7-4ee2-9877-f757db139ea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:51.186235 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-760592b7-faf7-4ee2-9877-f757db139ea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:51.187963 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-760592b7-faf7-4ee2-9877-f757db139ea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:51.190105 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-760592b7-faf7-4ee2-9877-f757db139ea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1746 microversion: 2.20 time: 0.221448 Nov 08 16:16:51.190882 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 483/958] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:50 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1746 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:51.229106 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-cd82ec11-0f9f-4087-9eee-23f68acf4a64 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:51.237919 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-cd82ec11-0f9f-4087-9eee-23f68acf4a64 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1721 microversion: 2.1 time: 0.212945 Nov 08 16:16:51.238654 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 476/959] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:51 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:16:52.208615 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d557b93d-0010-4893-9ce8-ddcc0c70cfc0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:52.209237 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d557b93d-0010-4893-9ce8-ddcc0c70cfc0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:52.217048 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d557b93d-0010-4893-9ce8-ddcc0c70cfc0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:52.217494 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d557b93d-0010-4893-9ce8-ddcc0c70cfc0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:52.218306 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d557b93d-0010-4893-9ce8-ddcc0c70cfc0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:52.218732 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d557b93d-0010-4893-9ce8-ddcc0c70cfc0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:52.257487 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-948baf70-f260-4a95-96db-b88ddead252a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:52.258146 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-948baf70-f260-4a95-96db-b88ddead252a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:52.269887 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-948baf70-f260-4a95-96db-b88ddead252a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:52.270360 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-948baf70-f260-4a95-96db-b88ddead252a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:52.271527 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-948baf70-f260-4a95-96db-b88ddead252a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:52.271969 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-948baf70-f260-4a95-96db-b88ddead252a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:52.407019 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-d557b93d-0010-4893-9ce8-ddcc0c70cfc0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:52.416260 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-d557b93d-0010-4893-9ce8-ddcc0c70cfc0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:52.418416 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-d557b93d-0010-4893-9ce8-ddcc0c70cfc0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:52.419904 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d557b93d-0010-4893-9ce8-ddcc0c70cfc0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1746 microversion: 2.20 time: 0.215324 Nov 08 16:16:52.420413 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 484/960] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:52 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1746 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:52.484441 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-948baf70-f260-4a95-96db-b88ddead252a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:52.492218 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-948baf70-f260-4a95-96db-b88ddead252a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1721 microversion: 2.1 time: 0.239664 Nov 08 16:16:52.492793 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 477/961] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:52 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:16:53.437886 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a4dd9d1d-0a35-4107-8733-50263336e65d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:53.438482 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a4dd9d1d-0a35-4107-8733-50263336e65d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:53.447352 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a4dd9d1d-0a35-4107-8733-50263336e65d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:53.447987 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a4dd9d1d-0a35-4107-8733-50263336e65d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:53.448954 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a4dd9d1d-0a35-4107-8733-50263336e65d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:53.449494 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a4dd9d1d-0a35-4107-8733-50263336e65d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:53.510604 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3e1a03be-8e94-40d2-a9a8-e1d01009d9ac tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:53.512061 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3e1a03be-8e94-40d2-a9a8-e1d01009d9ac tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:53.519498 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3e1a03be-8e94-40d2-a9a8-e1d01009d9ac tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:53.520264 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3e1a03be-8e94-40d2-a9a8-e1d01009d9ac tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:53.521247 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3e1a03be-8e94-40d2-a9a8-e1d01009d9ac tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:53.522076 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3e1a03be-8e94-40d2-a9a8-e1d01009d9ac tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:53.647078 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a4dd9d1d-0a35-4107-8733-50263336e65d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:53.660901 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a4dd9d1d-0a35-4107-8733-50263336e65d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:53.663578 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a4dd9d1d-0a35-4107-8733-50263336e65d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:53.664947 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a4dd9d1d-0a35-4107-8733-50263336e65d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1746 microversion: 2.20 time: 0.230696 Nov 08 16:16:53.666094 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 485/962] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:53 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1746 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:53.731224 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-024fc58d-1bb6-4211-a120-04b6bf38ecf7 req-27c58c73-7621-4504-86de-08b437169c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "name": "network-vif-plugged", "status": "completed", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:53.734959 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:16:53.734959 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:16:53.746445 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-024fc58d-1bb6-4211-a120-04b6bf38ecf7 req-27c58c73-7621-4504-86de-08b437169c9f service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:53.747202 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-024fc58d-1bb6-4211-a120-04b6bf38ecf7 req-27c58c73-7621-4504-86de-08b437169c9f service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:53.759204 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3e1a03be-8e94-40d2-a9a8-e1d01009d9ac tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:53.772363 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3e1a03be-8e94-40d2-a9a8-e1d01009d9ac tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1721 microversion: 2.1 time: 0.265645 Nov 08 16:16:53.773127 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 478/963] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:53 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1721 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:16:53.787098 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-024fc58d-1bb6-4211-a120-04b6bf38ecf7 req-27c58c73-7621-4504-86de-08b437169c9f service nova] Creating event network-vif-plugged:fbefda08-fc7a-42a0-b714-6dea3d8a5161 for instance 1c1c8c8d-5f78-45fb-803d-8f7a84df3433 on hv-cinder-81618 Nov 08 16:16:53.795909 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-024fc58d-1bb6-4211-a120-04b6bf38ecf7 req-27c58c73-7621-4504-86de-08b437169c9f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071625 Nov 08 16:16:53.796829 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 486/964] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:16:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:16:54.683329 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-337ce024-60c7-4961-89a2-43e546b4f73f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:54.684622 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-337ce024-60c7-4961-89a2-43e546b4f73f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:54.691459 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-337ce024-60c7-4961-89a2-43e546b4f73f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:54.692094 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-337ce024-60c7-4961-89a2-43e546b4f73f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:54.692869 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-337ce024-60c7-4961-89a2-43e546b4f73f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:54.693296 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-337ce024-60c7-4961-89a2-43e546b4f73f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:54.790504 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bcdfffc7-3a07-45b6-b4a7-94986de8b479 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:54.792600 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-bcdfffc7-3a07-45b6-b4a7-94986de8b479 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:54.800118 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bcdfffc7-3a07-45b6-b4a7-94986de8b479 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:54.800792 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bcdfffc7-3a07-45b6-b4a7-94986de8b479 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:54.802345 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bcdfffc7-3a07-45b6-b4a7-94986de8b479 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:54.802948 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bcdfffc7-3a07-45b6-b4a7-94986de8b479 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:54.836791 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-337ce024-60c7-4961-89a2-43e546b4f73f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:54.847038 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-337ce024-60c7-4961-89a2-43e546b4f73f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:54.848841 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-337ce024-60c7-4961-89a2-43e546b4f73f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:54.850236 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-337ce024-60c7-4961-89a2-43e546b4f73f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1746 microversion: 2.20 time: 0.170606 Nov 08 16:16:54.861131 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 479/965] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:54 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:54.958367 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-bcdfffc7-3a07-45b6-b4a7-94986de8b479 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:54.966334 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bcdfffc7-3a07-45b6-b4a7-94986de8b479 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1721 microversion: 2.1 time: 0.180374 Nov 08 16:16:54.967138 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 487/966] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:54 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:16:55.868642 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-852b23ee-f254-4217-be9f-f9edc59921bb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:55.869690 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-852b23ee-f254-4217-be9f-f9edc59921bb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:55.876769 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-852b23ee-f254-4217-be9f-f9edc59921bb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:55.877593 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-852b23ee-f254-4217-be9f-f9edc59921bb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:55.878485 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-852b23ee-f254-4217-be9f-f9edc59921bb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:55.879225 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-852b23ee-f254-4217-be9f-f9edc59921bb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:55.983395 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ebdbf079-757e-4643-85af-9c15ba1522f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:55.984590 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ebdbf079-757e-4643-85af-9c15ba1522f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:55.991302 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ebdbf079-757e-4643-85af-9c15ba1522f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:55.991754 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ebdbf079-757e-4643-85af-9c15ba1522f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:55.992539 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ebdbf079-757e-4643-85af-9c15ba1522f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:55.992975 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ebdbf079-757e-4643-85af-9c15ba1522f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:56.105327 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-852b23ee-f254-4217-be9f-f9edc59921bb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:56.113826 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-852b23ee-f254-4217-be9f-f9edc59921bb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:56.115489 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-852b23ee-f254-4217-be9f-f9edc59921bb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:56.116776 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-852b23ee-f254-4217-be9f-f9edc59921bb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1746 microversion: 2.20 time: 0.252404 Nov 08 16:16:56.117398 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 480/967] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:55 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1746 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:56.180283 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-ebdbf079-757e-4643-85af-9c15ba1522f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:56.190333 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ebdbf079-757e-4643-85af-9c15ba1522f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1698 microversion: 2.1 time: 0.210512 Nov 08 16:16:56.190931 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 488/968] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:55 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1698 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:16:56.213385 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-50eb3b3a-287c-48c8-81a2-300ffa70b884 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:16:56.221312 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-50eb3b3a-287c-48c8-81a2-300ffa70b884 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:56.221836 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-50eb3b3a-287c-48c8-81a2-300ffa70b884 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:56.255259 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-50eb3b3a-287c-48c8-81a2-300ffa70b884 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Going to try to start instance {{(pid=115523) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 08 16:16:56.307227 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-50eb3b3a-287c-48c8-81a2-300ffa70b884 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 202 len: 0 microversion: 2.1 time: 0.100951 Nov 08 16:16:56.307911 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 481/969] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:16:56 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:16:56.317296 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-8089f173-27f9-4a14-b2b4-1b0db4692776 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:56.317950 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-8089f173-27f9-4a14-b2b4-1b0db4692776 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:56.324402 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8089f173-27f9-4a14-b2b4-1b0db4692776 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:56.325154 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8089f173-27f9-4a14-b2b4-1b0db4692776 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:56.326440 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8089f173-27f9-4a14-b2b4-1b0db4692776 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:56.327398 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8089f173-27f9-4a14-b2b4-1b0db4692776 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:56.474627 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-8089f173-27f9-4a14-b2b4-1b0db4692776 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:56.484137 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-8089f173-27f9-4a14-b2b4-1b0db4692776 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1707 microversion: 2.1 time: 0.171368 Nov 08 16:16:56.484647 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 489/970] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:56 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1707 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:16:57.136659 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d816a540-ed55-47c8-beae-a0a74af3577c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:57.137353 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d816a540-ed55-47c8-beae-a0a74af3577c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:57.144670 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d816a540-ed55-47c8-beae-a0a74af3577c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:57.145108 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d816a540-ed55-47c8-beae-a0a74af3577c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:57.147951 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d816a540-ed55-47c8-beae-a0a74af3577c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:57.151085 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d816a540-ed55-47c8-beae-a0a74af3577c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:57.301234 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d816a540-ed55-47c8-beae-a0a74af3577c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:57.313554 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d816a540-ed55-47c8-beae-a0a74af3577c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:57.316936 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d816a540-ed55-47c8-beae-a0a74af3577c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:57.318659 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d816a540-ed55-47c8-beae-a0a74af3577c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1741 microversion: 2.20 time: 0.186387 Nov 08 16:16:57.331820 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 482/971] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:57 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:16:57.502741 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f3141dfe-cee7-47e9-960e-7b1078c4539e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:57.505166 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f3141dfe-cee7-47e9-960e-7b1078c4539e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:57.513897 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f3141dfe-cee7-47e9-960e-7b1078c4539e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:57.515194 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f3141dfe-cee7-47e9-960e-7b1078c4539e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:57.516043 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f3141dfe-cee7-47e9-960e-7b1078c4539e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:57.516716 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f3141dfe-cee7-47e9-960e-7b1078c4539e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:57.716077 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f3141dfe-cee7-47e9-960e-7b1078c4539e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:57.726327 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f3141dfe-cee7-47e9-960e-7b1078c4539e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1707 microversion: 2.1 time: 0.227659 Nov 08 16:16:57.727048 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 490/972] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:57 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1707 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:16:58.340506 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-17db2660-f4ba-4c43-a7f1-dd60a6aa85f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:58.342350 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-17db2660-f4ba-4c43-a7f1-dd60a6aa85f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:58.351098 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-17db2660-f4ba-4c43-a7f1-dd60a6aa85f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:58.351553 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-17db2660-f4ba-4c43-a7f1-dd60a6aa85f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:58.352418 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-17db2660-f4ba-4c43-a7f1-dd60a6aa85f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:58.353128 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-17db2660-f4ba-4c43-a7f1-dd60a6aa85f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:58.551481 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-17db2660-f4ba-4c43-a7f1-dd60a6aa85f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:58.562389 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-17db2660-f4ba-4c43-a7f1-dd60a6aa85f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:58.566768 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-17db2660-f4ba-4c43-a7f1-dd60a6aa85f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:58.568231 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-17db2660-f4ba-4c43-a7f1-dd60a6aa85f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1741 microversion: 2.20 time: 0.232605 Nov 08 16:16:58.569296 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 483/973] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:58 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1741 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:16:58.746078 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-64fd4f71-e209-4869-936e-c8cef81530b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:58.746699 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-64fd4f71-e209-4869-936e-c8cef81530b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:58.764835 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-64fd4f71-e209-4869-936e-c8cef81530b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:58.765366 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-64fd4f71-e209-4869-936e-c8cef81530b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:58.766482 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-64fd4f71-e209-4869-936e-c8cef81530b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:58.766973 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-64fd4f71-e209-4869-936e-c8cef81530b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:58.965779 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-64fd4f71-e209-4869-936e-c8cef81530b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:58.974368 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-64fd4f71-e209-4869-936e-c8cef81530b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1711 microversion: 2.1 time: 0.234093 Nov 08 16:16:58.975304 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 491/974] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:16:58 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1711 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:16:59.586422 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3313a5b9-51a7-4d59-9b78-468a66b0182f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:16:59.587061 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3313a5b9-51a7-4d59-9b78-468a66b0182f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:16:59.598769 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3313a5b9-51a7-4d59-9b78-468a66b0182f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:59.599235 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3313a5b9-51a7-4d59-9b78-468a66b0182f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:59.599992 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3313a5b9-51a7-4d59-9b78-468a66b0182f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:16:59.600422 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3313a5b9-51a7-4d59-9b78-468a66b0182f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:16:59.867786 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3313a5b9-51a7-4d59-9b78-468a66b0182f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:59.880551 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3313a5b9-51a7-4d59-9b78-468a66b0182f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:59.882830 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3313a5b9-51a7-4d59-9b78-468a66b0182f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:16:59.884553 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3313a5b9-51a7-4d59-9b78-468a66b0182f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1741 microversion: 2.20 time: 0.302045 Nov 08 16:16:59.886237 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 484/975] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:16:59 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1741 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:00.903967 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-06255980-c580-4809-a03a-38ac8fb9938d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:00.904629 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-06255980-c580-4809-a03a-38ac8fb9938d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:00.912602 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-06255980-c580-4809-a03a-38ac8fb9938d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:00.913041 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-06255980-c580-4809-a03a-38ac8fb9938d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:00.913855 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-06255980-c580-4809-a03a-38ac8fb9938d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:00.914466 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-06255980-c580-4809-a03a-38ac8fb9938d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:01.118278 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-06255980-c580-4809-a03a-38ac8fb9938d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:01.129905 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-06255980-c580-4809-a03a-38ac8fb9938d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:01.131466 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-06255980-c580-4809-a03a-38ac8fb9938d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:01.132794 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-06255980-c580-4809-a03a-38ac8fb9938d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1741 microversion: 2.20 time: 0.232377 Nov 08 16:17:01.144650 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 492/976] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:00 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1741 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:02.150886 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-bed98680-05d1-409f-914c-7a6c38b462ba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:02.151508 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-bed98680-05d1-409f-914c-7a6c38b462ba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:02.160955 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bed98680-05d1-409f-914c-7a6c38b462ba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:02.161395 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bed98680-05d1-409f-914c-7a6c38b462ba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:02.162199 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bed98680-05d1-409f-914c-7a6c38b462ba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:02.162632 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bed98680-05d1-409f-914c-7a6c38b462ba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:02.337518 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-bed98680-05d1-409f-914c-7a6c38b462ba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:02.349008 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-bed98680-05d1-409f-914c-7a6c38b462ba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:02.350807 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-bed98680-05d1-409f-914c-7a6c38b462ba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:02.352239 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-bed98680-05d1-409f-914c-7a6c38b462ba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1741 microversion: 2.20 time: 0.204926 Nov 08 16:17:02.353679 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 485/977] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:02 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1741 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:03.377028 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-18eef6b4-45ed-4726-8eb3-ba7ef0f2c35e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:03.379621 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-18eef6b4-45ed-4726-8eb3-ba7ef0f2c35e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:03.391765 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-18eef6b4-45ed-4726-8eb3-ba7ef0f2c35e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:03.394645 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-18eef6b4-45ed-4726-8eb3-ba7ef0f2c35e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:03.395605 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-18eef6b4-45ed-4726-8eb3-ba7ef0f2c35e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:03.396049 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-18eef6b4-45ed-4726-8eb3-ba7ef0f2c35e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:03.630782 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-18eef6b4-45ed-4726-8eb3-ba7ef0f2c35e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:03.644141 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-18eef6b4-45ed-4726-8eb3-ba7ef0f2c35e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:03.648125 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-18eef6b4-45ed-4726-8eb3-ba7ef0f2c35e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:03.656972 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-18eef6b4-45ed-4726-8eb3-ba7ef0f2c35e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1741 microversion: 2.20 time: 0.286132 Nov 08 16:17:03.660414 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 493/978] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:03 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1741 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:04.678140 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-80b738dc-b5fe-40c1-8578-a6c9b5d9d72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:04.678902 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-80b738dc-b5fe-40c1-8578-a6c9b5d9d72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:04.692816 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-80b738dc-b5fe-40c1-8578-a6c9b5d9d72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:04.693259 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-80b738dc-b5fe-40c1-8578-a6c9b5d9d72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:04.694079 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-80b738dc-b5fe-40c1-8578-a6c9b5d9d72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:04.701623 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-80b738dc-b5fe-40c1-8578-a6c9b5d9d72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:04.992951 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-80b738dc-b5fe-40c1-8578-a6c9b5d9d72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:05.008902 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-80b738dc-b5fe-40c1-8578-a6c9b5d9d72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:05.013995 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-80b738dc-b5fe-40c1-8578-a6c9b5d9d72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:05.016534 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-80b738dc-b5fe-40c1-8578-a6c9b5d9d72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1741 microversion: 2.20 time: 0.344206 Nov 08 16:17:05.017687 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 486/979] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:04 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1741 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:06.038950 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-fdb85a97-ef95-4307-9e5a-66a7bb7d7647 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:06.040378 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-fdb85a97-ef95-4307-9e5a-66a7bb7d7647 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:06.058431 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fdb85a97-ef95-4307-9e5a-66a7bb7d7647 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:06.060655 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fdb85a97-ef95-4307-9e5a-66a7bb7d7647 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:06.061668 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fdb85a97-ef95-4307-9e5a-66a7bb7d7647 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:06.062326 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fdb85a97-ef95-4307-9e5a-66a7bb7d7647 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:06.388450 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-fdb85a97-ef95-4307-9e5a-66a7bb7d7647 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:06.402566 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-fdb85a97-ef95-4307-9e5a-66a7bb7d7647 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:06.409382 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-fdb85a97-ef95-4307-9e5a-66a7bb7d7647 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:06.411213 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-fdb85a97-ef95-4307-9e5a-66a7bb7d7647 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1741 microversion: 2.20 time: 0.379036 Nov 08 16:17:06.424810 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 494/980] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:06 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1741 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:17:07.437092 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-08b50cef-3b20-44d0-9f77-0ed0b37c2526 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:07.437964 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-08b50cef-3b20-44d0-9f77-0ed0b37c2526 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:07.457612 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-08b50cef-3b20-44d0-9f77-0ed0b37c2526 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:07.458092 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-08b50cef-3b20-44d0-9f77-0ed0b37c2526 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:07.458931 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-08b50cef-3b20-44d0-9f77-0ed0b37c2526 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:07.459328 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-08b50cef-3b20-44d0-9f77-0ed0b37c2526 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:07.964374 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-08b50cef-3b20-44d0-9f77-0ed0b37c2526 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:07.978984 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-08b50cef-3b20-44d0-9f77-0ed0b37c2526 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:07.986413 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-08b50cef-3b20-44d0-9f77-0ed0b37c2526 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:07.987611 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-08b50cef-3b20-44d0-9f77-0ed0b37c2526 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1741 microversion: 2.20 time: 0.561858 Nov 08 16:17:07.988175 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 487/981] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:07 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1741 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:09.007030 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f509f9e7-6c5a-4a7b-8a18-bf20800733c9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:09.008516 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f509f9e7-6c5a-4a7b-8a18-bf20800733c9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:09.018072 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f509f9e7-6c5a-4a7b-8a18-bf20800733c9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:09.018579 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f509f9e7-6c5a-4a7b-8a18-bf20800733c9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:09.019413 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f509f9e7-6c5a-4a7b-8a18-bf20800733c9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:09.021826 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f509f9e7-6c5a-4a7b-8a18-bf20800733c9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:09.275868 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f509f9e7-6c5a-4a7b-8a18-bf20800733c9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:09.285028 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f509f9e7-6c5a-4a7b-8a18-bf20800733c9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:09.287555 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f509f9e7-6c5a-4a7b-8a18-bf20800733c9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:09.289025 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f509f9e7-6c5a-4a7b-8a18-bf20800733c9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1741 microversion: 2.20 time: 0.286553 Nov 08 16:17:09.301349 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 495/982] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:09 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1741 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:10.310040 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f5812153-debb-49c1-a421-26bc04fb6684 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:10.313160 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f5812153-debb-49c1-a421-26bc04fb6684 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:10.326704 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f5812153-debb-49c1-a421-26bc04fb6684 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:10.327139 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f5812153-debb-49c1-a421-26bc04fb6684 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:10.328222 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f5812153-debb-49c1-a421-26bc04fb6684 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:10.328506 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f5812153-debb-49c1-a421-26bc04fb6684 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:10.578743 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f5812153-debb-49c1-a421-26bc04fb6684 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:10.591360 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f5812153-debb-49c1-a421-26bc04fb6684 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:10.593337 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f5812153-debb-49c1-a421-26bc04fb6684 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:10.596361 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f5812153-debb-49c1-a421-26bc04fb6684 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1723 microversion: 2.20 time: 0.291457 Nov 08 16:17:10.598141 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 488/983] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:10 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:11.616129 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-faa6a98a-929a-45c8-9be9-a3ee495c240a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:11.618167 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-faa6a98a-929a-45c8-9be9-a3ee495c240a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:11.628919 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-faa6a98a-929a-45c8-9be9-a3ee495c240a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:11.629618 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-faa6a98a-929a-45c8-9be9-a3ee495c240a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:11.630700 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-faa6a98a-929a-45c8-9be9-a3ee495c240a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:11.631354 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-faa6a98a-929a-45c8-9be9-a3ee495c240a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:11.828006 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-faa6a98a-929a-45c8-9be9-a3ee495c240a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:11.854928 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-faa6a98a-929a-45c8-9be9-a3ee495c240a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:11.856952 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-faa6a98a-929a-45c8-9be9-a3ee495c240a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:11.859470 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-faa6a98a-929a-45c8-9be9-a3ee495c240a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1723 microversion: 2.20 time: 0.247565 Nov 08 16:17:11.864579 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 496/984] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:11 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:17:12.894165 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8d6a6dc4-e6a0-4bb1-be6e-30c475b9c950 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:12.896590 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8d6a6dc4-e6a0-4bb1-be6e-30c475b9c950 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:12.911141 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8d6a6dc4-e6a0-4bb1-be6e-30c475b9c950 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:12.911847 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8d6a6dc4-e6a0-4bb1-be6e-30c475b9c950 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:12.913035 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8d6a6dc4-e6a0-4bb1-be6e-30c475b9c950 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:12.919678 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8d6a6dc4-e6a0-4bb1-be6e-30c475b9c950 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:13.180101 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8d6a6dc4-e6a0-4bb1-be6e-30c475b9c950 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:13.193956 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8d6a6dc4-e6a0-4bb1-be6e-30c475b9c950 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:13.196551 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8d6a6dc4-e6a0-4bb1-be6e-30c475b9c950 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:13.198776 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8d6a6dc4-e6a0-4bb1-be6e-30c475b9c950 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1666 microversion: 2.20 time: 0.319315 Nov 08 16:17:13.211631 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 489/985] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:12 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1666 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:13.216573 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0b894a7e-0ff5-4d0d-8d4d-eb4b99ccc0ba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a08ec66-fd01-4f89-88ce-00290b3f851a"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:17:13.217843 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0b894a7e-0ff5-4d0d-8d4d-eb4b99ccc0ba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:13.227816 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0b894a7e-0ff5-4d0d-8d4d-eb4b99ccc0ba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:13.228503 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0b894a7e-0ff5-4d0d-8d4d-eb4b99ccc0ba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:13.229461 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0b894a7e-0ff5-4d0d-8d4d-eb4b99ccc0ba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:13.230075 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0b894a7e-0ff5-4d0d-8d4d-eb4b99ccc0ba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:13.774852 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0b894a7e-0ff5-4d0d-8d4d-eb4b99ccc0ba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.561707 Nov 08 16:17:13.775537 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 497/986] 10.222.0.37 () {62 vars in 1363 bytes} [Mon Nov 8 16:17:13 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/os-volume_attachments => generated 188 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:17:13.929200 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-30f40d24-b2de-4f04-913e-65a2494d3dc8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:17:13.934488 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-30f40d24-b2de-4f04-913e-65a2494d3dc8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:13.944368 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-30f40d24-b2de-4f04-913e-65a2494d3dc8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:13.945054 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-30f40d24-b2de-4f04-913e-65a2494d3dc8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:13.946041 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-30f40d24-b2de-4f04-913e-65a2494d3dc8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:13.946734 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-30f40d24-b2de-4f04-913e-65a2494d3dc8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:14.260287 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-30f40d24-b2de-4f04-913e-65a2494d3dc8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action" status: 202 len: 0 microversion: 2.20 time: 0.336111 Nov 08 16:17:14.261359 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 490/987] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:17:13 2021] POST /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:17:14.276184 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f55417e2-ac1d-4f65-8c37-be19eefb78b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:14.277333 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f55417e2-ac1d-4f65-8c37-be19eefb78b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:14.284795 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f55417e2-ac1d-4f65-8c37-be19eefb78b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:14.285502 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f55417e2-ac1d-4f65-8c37-be19eefb78b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:14.286642 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f55417e2-ac1d-4f65-8c37-be19eefb78b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:14.287237 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f55417e2-ac1d-4f65-8c37-be19eefb78b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:14.414689 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-8ae4e869-21f2-4125-8c97-7ec92faa6dc4 req-a184ea20-3b11-424e-ad70-d112dff551a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "name": "network-vif-unplugged", "status": "completed", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:17:14.417291 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:17:14.417291 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:17:14.430852 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-8ae4e869-21f2-4125-8c97-7ec92faa6dc4 req-a184ea20-3b11-424e-ad70-d112dff551a5 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:14.435851 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-8ae4e869-21f2-4125-8c97-7ec92faa6dc4 req-a184ea20-3b11-424e-ad70-d112dff551a5 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:14.450186 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.compute.server_external_events [req-8ae4e869-21f2-4125-8c97-7ec92faa6dc4 req-a184ea20-3b11-424e-ad70-d112dff551a5 service nova] Unable to find a host for instance 1c1c8c8d-5f78-45fb-803d-8f7a84df3433. Dropping event network-vif-unplugged {{(pid=115524) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 08 16:17:14.451618 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-8ae4e869-21f2-4125-8c97-7ec92faa6dc4 req-a184ea20-3b11-424e-ad70-d112dff551a5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.349202 Nov 08 16:17:14.452678 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 498/988] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:17:14 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 351 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 08 16:17:14.634422 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f55417e2-ac1d-4f65-8c37-be19eefb78b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:14.645777 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f55417e2-ac1d-4f65-8c37-be19eefb78b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:14.648763 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f55417e2-ac1d-4f65-8c37-be19eefb78b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:14.651978 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f55417e2-ac1d-4f65-8c37-be19eefb78b2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1752 microversion: 2.20 time: 0.386338 Nov 08 16:17:14.653241 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 491/989] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:14 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1752 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:15.670549 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5b670c24-b983-4fbe-86b7-96f10ce90b3a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:15.671176 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5b670c24-b983-4fbe-86b7-96f10ce90b3a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:15.677286 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5b670c24-b983-4fbe-86b7-96f10ce90b3a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:15.677763 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5b670c24-b983-4fbe-86b7-96f10ce90b3a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:15.678572 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5b670c24-b983-4fbe-86b7-96f10ce90b3a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:15.679013 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5b670c24-b983-4fbe-86b7-96f10ce90b3a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:15.912065 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-5b670c24-b983-4fbe-86b7-96f10ce90b3a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:15.921668 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-5b670c24-b983-4fbe-86b7-96f10ce90b3a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:15.924989 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-5b670c24-b983-4fbe-86b7-96f10ce90b3a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:15.926339 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5b670c24-b983-4fbe-86b7-96f10ce90b3a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1752 microversion: 2.20 time: 0.260295 Nov 08 16:17:15.927315 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 499/990] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:15 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1752 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:16.945653 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9a8f1674-0cde-484d-a2c5-1139df20a124 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:16.947041 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-9a8f1674-0cde-484d-a2c5-1139df20a124 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:16.960023 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9a8f1674-0cde-484d-a2c5-1139df20a124 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:16.960747 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9a8f1674-0cde-484d-a2c5-1139df20a124 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:16.961699 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9a8f1674-0cde-484d-a2c5-1139df20a124 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:16.962321 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9a8f1674-0cde-484d-a2c5-1139df20a124 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:17.188706 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-9a8f1674-0cde-484d-a2c5-1139df20a124 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:17.206275 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-9a8f1674-0cde-484d-a2c5-1139df20a124 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:17.209523 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-9a8f1674-0cde-484d-a2c5-1139df20a124 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:17.219139 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-9a8f1674-0cde-484d-a2c5-1139df20a124 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.269922 Nov 08 16:17:17.237677 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 492/991] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:16 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:18.244433 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-6ea3b2de-e08e-4acc-8442-84b47df86394 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:18.245038 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-6ea3b2de-e08e-4acc-8442-84b47df86394 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:18.262001 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6ea3b2de-e08e-4acc-8442-84b47df86394 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:18.262374 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6ea3b2de-e08e-4acc-8442-84b47df86394 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:18.263182 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6ea3b2de-e08e-4acc-8442-84b47df86394 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:18.265533 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6ea3b2de-e08e-4acc-8442-84b47df86394 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:18.614140 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-6ea3b2de-e08e-4acc-8442-84b47df86394 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:18.626134 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-6ea3b2de-e08e-4acc-8442-84b47df86394 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:18.627646 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-6ea3b2de-e08e-4acc-8442-84b47df86394 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:18.628848 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-6ea3b2de-e08e-4acc-8442-84b47df86394 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.388461 Nov 08 16:17:18.645675 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 500/992] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:18 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:19.647495 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-371c5a09-da36-449d-977a-34206154722c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:19.648089 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-371c5a09-da36-449d-977a-34206154722c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:19.657973 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-371c5a09-da36-449d-977a-34206154722c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:19.660276 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-371c5a09-da36-449d-977a-34206154722c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:19.661305 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-371c5a09-da36-449d-977a-34206154722c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:19.666224 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-371c5a09-da36-449d-977a-34206154722c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:20.085347 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-371c5a09-da36-449d-977a-34206154722c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:20.097832 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-371c5a09-da36-449d-977a-34206154722c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:20.099478 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-371c5a09-da36-449d-977a-34206154722c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:20.100916 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-371c5a09-da36-449d-977a-34206154722c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.457345 Nov 08 16:17:20.112185 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 493/993] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:19 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:21.121375 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-329b9bf3-38e7-4e9f-a153-64a2906fca8e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:21.126659 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-329b9bf3-38e7-4e9f-a153-64a2906fca8e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:21.133380 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-329b9bf3-38e7-4e9f-a153-64a2906fca8e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:21.134102 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-329b9bf3-38e7-4e9f-a153-64a2906fca8e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:21.135052 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-329b9bf3-38e7-4e9f-a153-64a2906fca8e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:21.135666 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-329b9bf3-38e7-4e9f-a153-64a2906fca8e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:21.297242 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-329b9bf3-38e7-4e9f-a153-64a2906fca8e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:21.306305 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-329b9bf3-38e7-4e9f-a153-64a2906fca8e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:21.308174 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-329b9bf3-38e7-4e9f-a153-64a2906fca8e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:21.309411 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-329b9bf3-38e7-4e9f-a153-64a2906fca8e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.192067 Nov 08 16:17:21.310395 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 501/994] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:21 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:22.327503 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3e44b91d-c15b-47f0-9795-5bab44a29322 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:22.328202 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3e44b91d-c15b-47f0-9795-5bab44a29322 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:22.340994 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3e44b91d-c15b-47f0-9795-5bab44a29322 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:22.341362 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3e44b91d-c15b-47f0-9795-5bab44a29322 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:22.341963 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3e44b91d-c15b-47f0-9795-5bab44a29322 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:22.342360 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3e44b91d-c15b-47f0-9795-5bab44a29322 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:22.521478 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3e44b91d-c15b-47f0-9795-5bab44a29322 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:22.534171 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3e44b91d-c15b-47f0-9795-5bab44a29322 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:22.535752 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3e44b91d-c15b-47f0-9795-5bab44a29322 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:22.537222 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3e44b91d-c15b-47f0-9795-5bab44a29322 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.213444 Nov 08 16:17:22.539929 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 494/995] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:22 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:23.555935 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0f2be6fc-df93-4aa4-8d2c-e6f644e7c275 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:23.557310 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0f2be6fc-df93-4aa4-8d2c-e6f644e7c275 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:23.564383 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0f2be6fc-df93-4aa4-8d2c-e6f644e7c275 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:23.564946 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0f2be6fc-df93-4aa4-8d2c-e6f644e7c275 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:23.565848 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0f2be6fc-df93-4aa4-8d2c-e6f644e7c275 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:23.566564 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0f2be6fc-df93-4aa4-8d2c-e6f644e7c275 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:23.724453 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0f2be6fc-df93-4aa4-8d2c-e6f644e7c275 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:23.733772 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0f2be6fc-df93-4aa4-8d2c-e6f644e7c275 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:23.735629 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0f2be6fc-df93-4aa4-8d2c-e6f644e7c275 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:23.737090 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0f2be6fc-df93-4aa4-8d2c-e6f644e7c275 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.184855 Nov 08 16:17:23.737740 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 502/996] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:23 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:24.762394 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b80e562f-a7e6-4b5c-a016-f05973aec4ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:24.763046 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b80e562f-a7e6-4b5c-a016-f05973aec4ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:24.770727 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b80e562f-a7e6-4b5c-a016-f05973aec4ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:24.772851 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b80e562f-a7e6-4b5c-a016-f05973aec4ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:24.774374 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b80e562f-a7e6-4b5c-a016-f05973aec4ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:24.774824 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b80e562f-a7e6-4b5c-a016-f05973aec4ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:25.001446 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b80e562f-a7e6-4b5c-a016-f05973aec4ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:25.013205 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b80e562f-a7e6-4b5c-a016-f05973aec4ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:25.014769 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b80e562f-a7e6-4b5c-a016-f05973aec4ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:25.017762 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b80e562f-a7e6-4b5c-a016-f05973aec4ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.261171 Nov 08 16:17:25.017762 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 495/997] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:24 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:25.721617 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bf52662f-1e5a-4def-a129-fc60dbdee452 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Action: 'create', calling method: .version_select at 0x7f8c073b3670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-659795178"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:17:25.746542 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-bf52662f-1e5a-4def-a129-fc60dbdee452 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Getting quotas for project 9ad6e5c060034b2ca263bfdcb07fe807. Resources: {'key_pairs'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:17:25.752175 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-bf52662f-1e5a-4def-a129-fc60dbdee452 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Getting quotas for user af064e4b18c0451da237604a7ecae5d3 and project 9ad6e5c060034b2ca263bfdcb07fe807. Resources: {'key_pairs'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:17:25.959697 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-bf52662f-1e5a-4def-a129-fc60dbdee452 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Getting quotas for project 9ad6e5c060034b2ca263bfdcb07fe807. Resources: {'key_pairs'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:17:25.963416 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-bf52662f-1e5a-4def-a129-fc60dbdee452 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Getting quotas for user af064e4b18c0451da237604a7ecae5d3 and project 9ad6e5c060034b2ca263bfdcb07fe807. Resources: {'key_pairs'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:17:25.977807 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bf52662f-1e5a-4def-a129-fc60dbdee452 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.259863 Nov 08 16:17:25.978420 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 503/998] 10.222.0.37 () {60 vars in 1157 bytes} [Mon Nov 8 16:17:25 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:26.026797 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a75dde96-b2a6-4804-b566-165b576626ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1781290834", "imageRef": "7b6cd27a-5dd6-4e5a-9b49-29d7123c3e32", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-659795178", "networks": [{"uuid": "52eb1d65-dc7c-45c5-9521-97cb18715837"}]}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:17:26.036668 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7faea5c1-6cc8-4fca-ab60-0a2b6583fef7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:26.037465 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7faea5c1-6cc8-4fca-ab60-0a2b6583fef7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:26.043612 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7faea5c1-6cc8-4fca-ab60-0a2b6583fef7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:26.044067 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7faea5c1-6cc8-4fca-ab60-0a2b6583fef7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:26.044851 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7faea5c1-6cc8-4fca-ab60-0a2b6583fef7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:26.045280 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7faea5c1-6cc8-4fca-ab60-0a2b6583fef7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:26.091121 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.network.neutron [None req-a75dde96-b2a6-4804-b566-165b576626ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] validate_networks() for [('52eb1d65-dc7c-45c5-9521-97cb18715837', None, None, None, None, None)] {{(pid=115523) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:17:26.306426 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7faea5c1-6cc8-4fca-ab60-0a2b6583fef7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:26.314826 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7faea5c1-6cc8-4fca-ab60-0a2b6583fef7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:26.316339 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7faea5c1-6cc8-4fca-ab60-0a2b6583fef7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:26.317510 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7faea5c1-6cc8-4fca-ab60-0a2b6583fef7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.286107 Nov 08 16:17:26.318556 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 504/999] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:26 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:26.521280 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-a75dde96-b2a6-4804-b566-165b576626ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Flavor limits 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:17:26.521774 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-a75dde96-b2a6-4804-b566-165b576626ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Image limits 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:17:26.522666 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-a75dde96-b2a6-4804-b566-165b576626ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Flavor pref 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:17:26.523144 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-a75dde96-b2a6-4804-b566-165b576626ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Image pref 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:17:26.523562 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-a75dde96-b2a6-4804-b566-165b576626ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:17:26.532950 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a75dde96-b2a6-4804-b566-165b576626ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:26.533385 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a75dde96-b2a6-4804-b566-165b576626ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:26.534223 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a75dde96-b2a6-4804-b566-165b576626ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:26.536429 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a75dde96-b2a6-4804-b566-165b576626ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:26.553980 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-a75dde96-b2a6-4804-b566-165b576626ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Getting quotas for project 9ad6e5c060034b2ca263bfdcb07fe807. Resources: {'instances', 'ram', 'cores'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:17:26.557812 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-a75dde96-b2a6-4804-b566-165b576626ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Getting quotas for user af064e4b18c0451da237604a7ecae5d3 and project 9ad6e5c060034b2ca263bfdcb07fe807. Resources: {'instances', 'ram', 'cores'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:17:26.569461 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a75dde96-b2a6-4804-b566-165b576626ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Going to run 1 instances... {{(pid=115523) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:17:26.571784 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a75dde96-b2a6-4804-b566-165b576626ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b6cd27a-5dd6-4e5a-9b49-29d7123c3e32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:17:26.622730 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a75dde96-b2a6-4804-b566-165b576626ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599806 Nov 08 16:17:26.628066 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 496/1000] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Nov 8 16:17:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 16:17:26.633324 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-fc4ce036-de18-4d54-897e-feeac045b4b5 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:26.634008 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-fc4ce036-de18-4d54-897e-feeac045b4b5 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:26.691710 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-fc4ce036-de18-4d54-897e-feeac045b4b5 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:26.698777 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-fc4ce036-de18-4d54-897e-feeac045b4b5 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1258 microversion: 2.1 time: 0.069094 Nov 08 16:17:26.699663 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 505/1001] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:26 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:17:27.336153 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-42052eab-10ef-4233-8a2f-b47f18bb90d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:27.336704 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-42052eab-10ef-4233-8a2f-b47f18bb90d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:27.343377 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-42052eab-10ef-4233-8a2f-b47f18bb90d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:27.343817 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-42052eab-10ef-4233-8a2f-b47f18bb90d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:27.345393 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-42052eab-10ef-4233-8a2f-b47f18bb90d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:27.345923 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-42052eab-10ef-4233-8a2f-b47f18bb90d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:27.481370 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-42052eab-10ef-4233-8a2f-b47f18bb90d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:27.490593 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-42052eab-10ef-4233-8a2f-b47f18bb90d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:27.492095 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-42052eab-10ef-4233-8a2f-b47f18bb90d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:27.493257 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-42052eab-10ef-4233-8a2f-b47f18bb90d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.161537 Nov 08 16:17:27.494001 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 497/1002] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:27 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:27.715864 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-97d91f6d-cbc9-48d1-9803-ec586bc4b491 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:27.716395 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-97d91f6d-cbc9-48d1-9803-ec586bc4b491 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:27.722863 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-97d91f6d-cbc9-48d1-9803-ec586bc4b491 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:27.723310 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-97d91f6d-cbc9-48d1-9803-ec586bc4b491 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:27.724094 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-97d91f6d-cbc9-48d1-9803-ec586bc4b491 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:27.724526 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-97d91f6d-cbc9-48d1-9803-ec586bc4b491 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:27.786251 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-97d91f6d-cbc9-48d1-9803-ec586bc4b491 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:27.793577 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-97d91f6d-cbc9-48d1-9803-ec586bc4b491 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1262 microversion: 2.1 time: 0.081438 Nov 08 16:17:27.794173 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 506/1003] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:27 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:28.511450 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ff62f2fe-5926-42a4-9829-0fe34db996b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:28.512139 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ff62f2fe-5926-42a4-9829-0fe34db996b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:28.518980 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ff62f2fe-5926-42a4-9829-0fe34db996b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:28.519431 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ff62f2fe-5926-42a4-9829-0fe34db996b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:28.520208 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ff62f2fe-5926-42a4-9829-0fe34db996b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:28.520639 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ff62f2fe-5926-42a4-9829-0fe34db996b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:28.652223 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ff62f2fe-5926-42a4-9829-0fe34db996b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:28.660598 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ff62f2fe-5926-42a4-9829-0fe34db996b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:28.662144 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ff62f2fe-5926-42a4-9829-0fe34db996b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:28.663346 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ff62f2fe-5926-42a4-9829-0fe34db996b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.155661 Nov 08 16:17:28.663886 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 498/1004] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:28 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:28.810366 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ff3eaaac-6229-49f3-b4b4-6fefbed9aee0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:28.810955 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ff3eaaac-6229-49f3-b4b4-6fefbed9aee0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:28.817887 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ff3eaaac-6229-49f3-b4b4-6fefbed9aee0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:28.818341 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ff3eaaac-6229-49f3-b4b4-6fefbed9aee0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:28.819123 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ff3eaaac-6229-49f3-b4b4-6fefbed9aee0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:28.819553 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ff3eaaac-6229-49f3-b4b4-6fefbed9aee0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:28.881668 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-ff3eaaac-6229-49f3-b4b4-6fefbed9aee0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:28.889179 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ff3eaaac-6229-49f3-b4b4-6fefbed9aee0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1262 microversion: 2.1 time: 0.082495 Nov 08 16:17:28.889834 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 507/1005] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:28 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:29.682294 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-34423593-9d3e-4cb2-9a1e-b90cc2a672cd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:29.682903 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-34423593-9d3e-4cb2-9a1e-b90cc2a672cd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:29.689431 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-34423593-9d3e-4cb2-9a1e-b90cc2a672cd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:29.689914 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-34423593-9d3e-4cb2-9a1e-b90cc2a672cd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:29.690682 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-34423593-9d3e-4cb2-9a1e-b90cc2a672cd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:29.691106 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-34423593-9d3e-4cb2-9a1e-b90cc2a672cd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:29.824291 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-34423593-9d3e-4cb2-9a1e-b90cc2a672cd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:29.832954 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-34423593-9d3e-4cb2-9a1e-b90cc2a672cd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:29.834484 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-34423593-9d3e-4cb2-9a1e-b90cc2a672cd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:29.835628 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-34423593-9d3e-4cb2-9a1e-b90cc2a672cd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.157654 Nov 08 16:17:29.836172 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 499/1006] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:29 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:29.905512 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b374d077-2de0-41c2-9b49-7367eb3f6c6e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:29.906205 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b374d077-2de0-41c2-9b49-7367eb3f6c6e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:29.913544 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b374d077-2de0-41c2-9b49-7367eb3f6c6e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:29.914062 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b374d077-2de0-41c2-9b49-7367eb3f6c6e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:29.915833 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b374d077-2de0-41c2-9b49-7367eb3f6c6e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:29.916327 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b374d077-2de0-41c2-9b49-7367eb3f6c6e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:29.979480 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b374d077-2de0-41c2-9b49-7367eb3f6c6e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:29.987020 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b374d077-2de0-41c2-9b49-7367eb3f6c6e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1262 microversion: 2.1 time: 0.085142 Nov 08 16:17:29.987592 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 508/1007] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:29 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:30.853896 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4bd3d3f7-245e-4c06-91b7-c218ebabaea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:30.854558 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4bd3d3f7-245e-4c06-91b7-c218ebabaea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:30.861359 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4bd3d3f7-245e-4c06-91b7-c218ebabaea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:30.861824 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4bd3d3f7-245e-4c06-91b7-c218ebabaea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:30.862576 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4bd3d3f7-245e-4c06-91b7-c218ebabaea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:30.862997 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4bd3d3f7-245e-4c06-91b7-c218ebabaea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:30.998780 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4bd3d3f7-245e-4c06-91b7-c218ebabaea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:31.004925 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b310d86b-74c0-483f-a66c-264209c7b891 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:31.005511 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b310d86b-74c0-483f-a66c-264209c7b891 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:31.007774 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4bd3d3f7-245e-4c06-91b7-c218ebabaea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:31.009293 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4bd3d3f7-245e-4c06-91b7-c218ebabaea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:31.010551 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4bd3d3f7-245e-4c06-91b7-c218ebabaea2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.160496 Nov 08 16:17:31.011100 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 500/1008] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:30 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:31.012149 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b310d86b-74c0-483f-a66c-264209c7b891 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:31.012602 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b310d86b-74c0-483f-a66c-264209c7b891 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:31.013389 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b310d86b-74c0-483f-a66c-264209c7b891 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:31.013853 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b310d86b-74c0-483f-a66c-264209c7b891 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:31.073932 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b310d86b-74c0-483f-a66c-264209c7b891 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:31.081834 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b310d86b-74c0-483f-a66c-264209c7b891 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1262 microversion: 2.1 time: 0.081199 Nov 08 16:17:31.082404 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 509/1009] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:30 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:17:32.029696 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4529e042-37c7-4580-be28-028da40787f3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:32.030504 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4529e042-37c7-4580-be28-028da40787f3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:32.037442 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4529e042-37c7-4580-be28-028da40787f3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:32.037924 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4529e042-37c7-4580-be28-028da40787f3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:32.038718 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4529e042-37c7-4580-be28-028da40787f3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:32.039149 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4529e042-37c7-4580-be28-028da40787f3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:32.098687 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e578a456-b06e-4191-90d7-9b0a4a0c72bc tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:32.099293 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e578a456-b06e-4191-90d7-9b0a4a0c72bc tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:32.106134 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e578a456-b06e-4191-90d7-9b0a4a0c72bc tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:32.106937 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e578a456-b06e-4191-90d7-9b0a4a0c72bc tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:32.108377 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e578a456-b06e-4191-90d7-9b0a4a0c72bc tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:32.108997 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e578a456-b06e-4191-90d7-9b0a4a0c72bc tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:32.188667 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e578a456-b06e-4191-90d7-9b0a4a0c72bc tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:32.198262 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e578a456-b06e-4191-90d7-9b0a4a0c72bc tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1262 microversion: 2.1 time: 0.103160 Nov 08 16:17:32.199144 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 510/1010] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:32 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1262 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:17:32.206218 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4529e042-37c7-4580-be28-028da40787f3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:32.215215 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4529e042-37c7-4580-be28-028da40787f3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:32.216729 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4529e042-37c7-4580-be28-028da40787f3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:32.217939 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4529e042-37c7-4580-be28-028da40787f3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.192102 Nov 08 16:17:32.219216 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 501/1011] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:32 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:33.215310 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bf93263e-6a0b-4429-aee8-d3e8193d8c6d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:33.215891 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-bf93263e-6a0b-4429-aee8-d3e8193d8c6d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:33.222764 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bf93263e-6a0b-4429-aee8-d3e8193d8c6d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:33.223213 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bf93263e-6a0b-4429-aee8-d3e8193d8c6d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:33.224051 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bf93263e-6a0b-4429-aee8-d3e8193d8c6d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:33.224516 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bf93263e-6a0b-4429-aee8-d3e8193d8c6d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:33.236258 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-055dba09-3286-4ab2-93ac-5fb202688619 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:33.236832 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-055dba09-3286-4ab2-93ac-5fb202688619 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:33.243398 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-055dba09-3286-4ab2-93ac-5fb202688619 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:33.243921 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-055dba09-3286-4ab2-93ac-5fb202688619 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:33.244767 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-055dba09-3286-4ab2-93ac-5fb202688619 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:33.245527 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-055dba09-3286-4ab2-93ac-5fb202688619 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:33.292022 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-bf93263e-6a0b-4429-aee8-d3e8193d8c6d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:33.299753 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bf93263e-6a0b-4429-aee8-d3e8193d8c6d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1262 microversion: 2.1 time: 0.088112 Nov 08 16:17:33.300831 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 511/1012] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:33 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:33.387073 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-055dba09-3286-4ab2-93ac-5fb202688619 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:33.395907 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-055dba09-3286-4ab2-93ac-5fb202688619 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:33.397388 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-055dba09-3286-4ab2-93ac-5fb202688619 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:33.398564 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-055dba09-3286-4ab2-93ac-5fb202688619 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.166062 Nov 08 16:17:33.399116 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 502/1013] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:33 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:17:34.316109 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-65edb6e4-0d96-4688-b6e5-a239608b9eb3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:34.316720 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-65edb6e4-0d96-4688-b6e5-a239608b9eb3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:34.322978 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-65edb6e4-0d96-4688-b6e5-a239608b9eb3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:34.323424 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-65edb6e4-0d96-4688-b6e5-a239608b9eb3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:34.324194 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-65edb6e4-0d96-4688-b6e5-a239608b9eb3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:34.324627 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-65edb6e4-0d96-4688-b6e5-a239608b9eb3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:34.381385 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-65edb6e4-0d96-4688-b6e5-a239608b9eb3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:34.388612 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-65edb6e4-0d96-4688-b6e5-a239608b9eb3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1262 microversion: 2.1 time: 0.076177 Nov 08 16:17:34.389174 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 512/1014] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:34 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1262 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:34.415943 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-01988810-43d7-463a-8ee7-6416c71dcdb2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:34.416531 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-01988810-43d7-463a-8ee7-6416c71dcdb2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:34.422798 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-01988810-43d7-463a-8ee7-6416c71dcdb2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:34.423230 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-01988810-43d7-463a-8ee7-6416c71dcdb2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:34.423988 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-01988810-43d7-463a-8ee7-6416c71dcdb2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:34.424412 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-01988810-43d7-463a-8ee7-6416c71dcdb2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:34.554038 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-01988810-43d7-463a-8ee7-6416c71dcdb2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:34.562103 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-01988810-43d7-463a-8ee7-6416c71dcdb2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:34.563583 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-01988810-43d7-463a-8ee7-6416c71dcdb2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:34.564737 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-01988810-43d7-463a-8ee7-6416c71dcdb2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.152430 Nov 08 16:17:34.565249 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 503/1015] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:34 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:35.405663 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-225fc743-05f8-44d8-9fdc-22d48255fb6f tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:35.406853 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-225fc743-05f8-44d8-9fdc-22d48255fb6f tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:35.413061 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-225fc743-05f8-44d8-9fdc-22d48255fb6f tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:35.413521 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-225fc743-05f8-44d8-9fdc-22d48255fb6f tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:35.414325 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-225fc743-05f8-44d8-9fdc-22d48255fb6f tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:35.414761 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-225fc743-05f8-44d8-9fdc-22d48255fb6f tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:35.471325 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-225fc743-05f8-44d8-9fdc-22d48255fb6f tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:35.478447 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-225fc743-05f8-44d8-9fdc-22d48255fb6f tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1262 microversion: 2.1 time: 0.076621 Nov 08 16:17:35.479009 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 513/1016] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:35 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1262 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:35.581997 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0e79df7b-a29d-4a9b-a954-5dd33350522f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:35.582624 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0e79df7b-a29d-4a9b-a954-5dd33350522f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:35.588808 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0e79df7b-a29d-4a9b-a954-5dd33350522f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:35.589238 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0e79df7b-a29d-4a9b-a954-5dd33350522f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:35.590026 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0e79df7b-a29d-4a9b-a954-5dd33350522f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:35.590451 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0e79df7b-a29d-4a9b-a954-5dd33350522f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:35.718213 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0e79df7b-a29d-4a9b-a954-5dd33350522f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:35.726246 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0e79df7b-a29d-4a9b-a954-5dd33350522f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:35.727718 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0e79df7b-a29d-4a9b-a954-5dd33350522f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:35.728850 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0e79df7b-a29d-4a9b-a954-5dd33350522f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.151115 Nov 08 16:17:35.729384 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 504/1017] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:35 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:36.494851 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-330356c1-9b34-463f-836b-b16a6063e7c7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:36.495640 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-330356c1-9b34-463f-836b-b16a6063e7c7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:36.501984 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-330356c1-9b34-463f-836b-b16a6063e7c7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:36.502429 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-330356c1-9b34-463f-836b-b16a6063e7c7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:36.503198 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-330356c1-9b34-463f-836b-b16a6063e7c7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:36.503639 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-330356c1-9b34-463f-836b-b16a6063e7c7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:36.560045 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-330356c1-9b34-463f-836b-b16a6063e7c7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:36.567057 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-330356c1-9b34-463f-836b-b16a6063e7c7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1262 microversion: 2.1 time: 0.075958 Nov 08 16:17:36.567614 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 514/1018] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:36 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1262 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:36.746008 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6afc9a71-c666-41c6-b5fa-2f9c6d95162a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:36.746539 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6afc9a71-c666-41c6-b5fa-2f9c6d95162a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:36.752765 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6afc9a71-c666-41c6-b5fa-2f9c6d95162a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:36.753200 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6afc9a71-c666-41c6-b5fa-2f9c6d95162a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:36.753981 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6afc9a71-c666-41c6-b5fa-2f9c6d95162a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:36.754427 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6afc9a71-c666-41c6-b5fa-2f9c6d95162a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:36.884024 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6afc9a71-c666-41c6-b5fa-2f9c6d95162a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:36.892527 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6afc9a71-c666-41c6-b5fa-2f9c6d95162a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:36.894046 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6afc9a71-c666-41c6-b5fa-2f9c6d95162a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:36.895194 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6afc9a71-c666-41c6-b5fa-2f9c6d95162a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.153214 Nov 08 16:17:36.895741 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 505/1019] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:36 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:37.583864 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-909e7743-24cf-4427-bc40-ed2772c715db tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:37.584501 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-909e7743-24cf-4427-bc40-ed2772c715db tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:37.590795 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-909e7743-24cf-4427-bc40-ed2772c715db tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:37.591248 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-909e7743-24cf-4427-bc40-ed2772c715db tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:37.592019 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-909e7743-24cf-4427-bc40-ed2772c715db tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:37.592465 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-909e7743-24cf-4427-bc40-ed2772c715db tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:37.649285 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-909e7743-24cf-4427-bc40-ed2772c715db tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:37.657680 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-909e7743-24cf-4427-bc40-ed2772c715db tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1262 microversion: 2.1 time: 0.077375 Nov 08 16:17:37.658179 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 515/1020] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:37 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1262 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:37.913222 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-24b4c3ce-41ed-490e-a76b-e3631e3be8b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:37.913846 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-24b4c3ce-41ed-490e-a76b-e3631e3be8b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:37.920332 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-24b4c3ce-41ed-490e-a76b-e3631e3be8b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:37.920769 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-24b4c3ce-41ed-490e-a76b-e3631e3be8b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:37.921524 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-24b4c3ce-41ed-490e-a76b-e3631e3be8b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:37.921983 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-24b4c3ce-41ed-490e-a76b-e3631e3be8b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:38.052272 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-24b4c3ce-41ed-490e-a76b-e3631e3be8b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:38.060777 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-24b4c3ce-41ed-490e-a76b-e3631e3be8b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:38.062816 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-24b4c3ce-41ed-490e-a76b-e3631e3be8b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:38.063972 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-24b4c3ce-41ed-490e-a76b-e3631e3be8b4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.154414 Nov 08 16:17:38.064521 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 506/1021] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:37 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:38.673738 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f23111a5-68ba-47e2-9c93-779b93a4fdd8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:38.674393 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f23111a5-68ba-47e2-9c93-779b93a4fdd8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:38.680683 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f23111a5-68ba-47e2-9c93-779b93a4fdd8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:38.681138 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f23111a5-68ba-47e2-9c93-779b93a4fdd8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:38.682586 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f23111a5-68ba-47e2-9c93-779b93a4fdd8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:38.683026 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f23111a5-68ba-47e2-9c93-779b93a4fdd8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:38.756749 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f23111a5-68ba-47e2-9c93-779b93a4fdd8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:38.764914 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f23111a5-68ba-47e2-9c93-779b93a4fdd8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1318 microversion: 2.1 time: 0.094864 Nov 08 16:17:38.765561 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 516/1022] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:38 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1318 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:39.087415 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a79a807b-2f0a-474d-9476-464cc9d6afd5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:39.087963 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a79a807b-2f0a-474d-9476-464cc9d6afd5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:39.095000 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a79a807b-2f0a-474d-9476-464cc9d6afd5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:39.095819 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a79a807b-2f0a-474d-9476-464cc9d6afd5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:39.096674 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a79a807b-2f0a-474d-9476-464cc9d6afd5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:39.097107 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a79a807b-2f0a-474d-9476-464cc9d6afd5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:39.489696 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a79a807b-2f0a-474d-9476-464cc9d6afd5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:39.500646 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a79a807b-2f0a-474d-9476-464cc9d6afd5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:39.511818 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a79a807b-2f0a-474d-9476-464cc9d6afd5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:39.517293 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a79a807b-2f0a-474d-9476-464cc9d6afd5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.438446 Nov 08 16:17:39.518225 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 507/1023] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:39 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:39.781568 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d0607bc3-7227-4cf2-8560-5db1a3c6a05e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:39.782487 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d0607bc3-7227-4cf2-8560-5db1a3c6a05e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:39.788779 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d0607bc3-7227-4cf2-8560-5db1a3c6a05e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:39.789311 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d0607bc3-7227-4cf2-8560-5db1a3c6a05e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:39.790196 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d0607bc3-7227-4cf2-8560-5db1a3c6a05e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:39.790698 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d0607bc3-7227-4cf2-8560-5db1a3c6a05e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:39.929399 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-d0607bc3-7227-4cf2-8560-5db1a3c6a05e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:39.938217 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d0607bc3-7227-4cf2-8560-5db1a3c6a05e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.160442 Nov 08 16:17:39.939017 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 517/1024] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:39 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:40.541513 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-df8c1f66-2ebb-4164-a1d8-5ffbb1865644 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:40.542467 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-df8c1f66-2ebb-4164-a1d8-5ffbb1865644 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:40.549767 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-df8c1f66-2ebb-4164-a1d8-5ffbb1865644 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:40.553035 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-df8c1f66-2ebb-4164-a1d8-5ffbb1865644 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:40.554217 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-df8c1f66-2ebb-4164-a1d8-5ffbb1865644 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:40.554361 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-df8c1f66-2ebb-4164-a1d8-5ffbb1865644 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:40.736408 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-df8c1f66-2ebb-4164-a1d8-5ffbb1865644 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:40.744846 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-df8c1f66-2ebb-4164-a1d8-5ffbb1865644 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:40.746906 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-df8c1f66-2ebb-4164-a1d8-5ffbb1865644 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:40.749902 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-df8c1f66-2ebb-4164-a1d8-5ffbb1865644 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.215711 Nov 08 16:17:40.751083 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 508/1025] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:40 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:40.956563 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c3c24c51-048b-4489-8b68-5a83172a321a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:40.958011 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c3c24c51-048b-4489-8b68-5a83172a321a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:40.965226 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c3c24c51-048b-4489-8b68-5a83172a321a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:40.966093 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c3c24c51-048b-4489-8b68-5a83172a321a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:40.966999 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c3c24c51-048b-4489-8b68-5a83172a321a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:40.967507 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c3c24c51-048b-4489-8b68-5a83172a321a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:41.544424 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c3c24c51-048b-4489-8b68-5a83172a321a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:41.551692 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c3c24c51-048b-4489-8b68-5a83172a321a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.599920 Nov 08 16:17:41.554804 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 518/1026] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:40 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:17:41.767461 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-653df313-39cc-471e-9e79-eacd2a57fca5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:41.768077 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-653df313-39cc-471e-9e79-eacd2a57fca5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:41.774355 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-653df313-39cc-471e-9e79-eacd2a57fca5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:41.774780 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-653df313-39cc-471e-9e79-eacd2a57fca5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:41.775560 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-653df313-39cc-471e-9e79-eacd2a57fca5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:41.775995 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-653df313-39cc-471e-9e79-eacd2a57fca5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:41.944980 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-653df313-39cc-471e-9e79-eacd2a57fca5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:41.953874 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-653df313-39cc-471e-9e79-eacd2a57fca5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:41.955695 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-653df313-39cc-471e-9e79-eacd2a57fca5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:41.957109 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-653df313-39cc-471e-9e79-eacd2a57fca5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.193452 Nov 08 16:17:41.958155 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 509/1027] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:41 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:42.570902 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1715d59a-bc8d-4880-a776-61a6156deba7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:42.571612 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1715d59a-bc8d-4880-a776-61a6156deba7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:42.577977 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1715d59a-bc8d-4880-a776-61a6156deba7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:42.578692 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1715d59a-bc8d-4880-a776-61a6156deba7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:42.579701 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1715d59a-bc8d-4880-a776-61a6156deba7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:42.580363 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1715d59a-bc8d-4880-a776-61a6156deba7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:42.715582 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1715d59a-bc8d-4880-a776-61a6156deba7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:42.723346 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1715d59a-bc8d-4880-a776-61a6156deba7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.156084 Nov 08 16:17:42.724160 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 519/1028] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:42 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:42.975210 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3015241d-e0f4-4ee0-9bac-b149e9c739ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:42.976073 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3015241d-e0f4-4ee0-9bac-b149e9c739ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:42.984270 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3015241d-e0f4-4ee0-9bac-b149e9c739ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:42.985084 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3015241d-e0f4-4ee0-9bac-b149e9c739ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:42.986295 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3015241d-e0f4-4ee0-9bac-b149e9c739ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:42.987241 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3015241d-e0f4-4ee0-9bac-b149e9c739ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:43.135411 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3015241d-e0f4-4ee0-9bac-b149e9c739ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:43.145881 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3015241d-e0f4-4ee0-9bac-b149e9c739ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:43.147786 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3015241d-e0f4-4ee0-9bac-b149e9c739ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:43.149630 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3015241d-e0f4-4ee0-9bac-b149e9c739ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.178300 Nov 08 16:17:43.162784 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 510/1029] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:42 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:43.740294 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-20f1bc2b-8fd8-48d9-bfb2-6eb00e52e8fc tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:43.740882 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-20f1bc2b-8fd8-48d9-bfb2-6eb00e52e8fc tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:43.747326 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-20f1bc2b-8fd8-48d9-bfb2-6eb00e52e8fc tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:43.747774 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-20f1bc2b-8fd8-48d9-bfb2-6eb00e52e8fc tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:43.748541 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-20f1bc2b-8fd8-48d9-bfb2-6eb00e52e8fc tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:43.748968 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-20f1bc2b-8fd8-48d9-bfb2-6eb00e52e8fc tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:43.877511 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-20f1bc2b-8fd8-48d9-bfb2-6eb00e52e8fc tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:43.884544 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-20f1bc2b-8fd8-48d9-bfb2-6eb00e52e8fc tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.148028 Nov 08 16:17:43.885093 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 520/1030] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:43 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:44.170405 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d6dea372-ddcb-4f7e-8bf5-158740e5f5bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:44.171545 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d6dea372-ddcb-4f7e-8bf5-158740e5f5bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:44.177652 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d6dea372-ddcb-4f7e-8bf5-158740e5f5bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:44.178135 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d6dea372-ddcb-4f7e-8bf5-158740e5f5bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:44.178901 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d6dea372-ddcb-4f7e-8bf5-158740e5f5bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:44.179331 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d6dea372-ddcb-4f7e-8bf5-158740e5f5bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:44.314397 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d6dea372-ddcb-4f7e-8bf5-158740e5f5bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:44.322856 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d6dea372-ddcb-4f7e-8bf5-158740e5f5bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:44.324347 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d6dea372-ddcb-4f7e-8bf5-158740e5f5bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:44.325497 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d6dea372-ddcb-4f7e-8bf5-158740e5f5bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.158828 Nov 08 16:17:44.326082 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 511/1031] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:44 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:44.901554 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-68efad35-85e7-465e-9b72-144b083da6a3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:44.902288 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-68efad35-85e7-465e-9b72-144b083da6a3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:44.909104 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-68efad35-85e7-465e-9b72-144b083da6a3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:44.909564 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-68efad35-85e7-465e-9b72-144b083da6a3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:44.910386 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-68efad35-85e7-465e-9b72-144b083da6a3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:44.910829 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-68efad35-85e7-465e-9b72-144b083da6a3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:45.039541 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-68efad35-85e7-465e-9b72-144b083da6a3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:45.046685 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-68efad35-85e7-465e-9b72-144b083da6a3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.148777 Nov 08 16:17:45.047234 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 521/1032] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:44 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:45.343278 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a9bb425d-0316-480e-a05e-e957b5417691 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:45.343893 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a9bb425d-0316-480e-a05e-e957b5417691 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:45.350060 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a9bb425d-0316-480e-a05e-e957b5417691 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:45.350495 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a9bb425d-0316-480e-a05e-e957b5417691 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:45.351280 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a9bb425d-0316-480e-a05e-e957b5417691 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:45.351702 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a9bb425d-0316-480e-a05e-e957b5417691 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:45.481815 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a9bb425d-0316-480e-a05e-e957b5417691 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:45.489881 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a9bb425d-0316-480e-a05e-e957b5417691 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:45.491362 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a9bb425d-0316-480e-a05e-e957b5417691 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:45.492501 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a9bb425d-0316-480e-a05e-e957b5417691 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.152924 Nov 08 16:17:45.493053 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 512/1033] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:45 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:46.063104 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-aafbb310-ee87-4c2b-98a6-e1fcfbf75b1b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:46.063704 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-aafbb310-ee87-4c2b-98a6-e1fcfbf75b1b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:46.069892 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-aafbb310-ee87-4c2b-98a6-e1fcfbf75b1b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:46.070339 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-aafbb310-ee87-4c2b-98a6-e1fcfbf75b1b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:46.071096 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-aafbb310-ee87-4c2b-98a6-e1fcfbf75b1b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:46.071523 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-aafbb310-ee87-4c2b-98a6-e1fcfbf75b1b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:46.196499 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-aafbb310-ee87-4c2b-98a6-e1fcfbf75b1b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:46.203850 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-aafbb310-ee87-4c2b-98a6-e1fcfbf75b1b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.144397 Nov 08 16:17:46.204396 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 522/1034] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:46 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:46.510977 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ec26e310-7403-4426-afbc-ca3b0b9ec7a1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:46.511581 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ec26e310-7403-4426-afbc-ca3b0b9ec7a1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:46.518286 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ec26e310-7403-4426-afbc-ca3b0b9ec7a1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:46.518725 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ec26e310-7403-4426-afbc-ca3b0b9ec7a1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:46.519482 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ec26e310-7403-4426-afbc-ca3b0b9ec7a1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:46.519908 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ec26e310-7403-4426-afbc-ca3b0b9ec7a1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:46.644433 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ec26e310-7403-4426-afbc-ca3b0b9ec7a1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:46.652518 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ec26e310-7403-4426-afbc-ca3b0b9ec7a1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:46.654035 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ec26e310-7403-4426-afbc-ca3b0b9ec7a1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:46.655192 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ec26e310-7403-4426-afbc-ca3b0b9ec7a1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.147840 Nov 08 16:17:46.655794 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 513/1035] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:46 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:47.220894 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-29a357b4-8633-4735-a24c-20b83a31a8aa tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:47.221574 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-29a357b4-8633-4735-a24c-20b83a31a8aa tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:47.228090 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-29a357b4-8633-4735-a24c-20b83a31a8aa tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:47.228538 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-29a357b4-8633-4735-a24c-20b83a31a8aa tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:47.229321 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-29a357b4-8633-4735-a24c-20b83a31a8aa tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:47.229769 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-29a357b4-8633-4735-a24c-20b83a31a8aa tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:47.388613 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-29a357b4-8633-4735-a24c-20b83a31a8aa tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:47.396724 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-29a357b4-8633-4735-a24c-20b83a31a8aa tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.180026 Nov 08 16:17:47.397290 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 523/1036] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:47 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:47.673255 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-12fa5825-0f8c-4042-b27d-54c8db6dffc7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:47.673877 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-12fa5825-0f8c-4042-b27d-54c8db6dffc7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:47.680088 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-12fa5825-0f8c-4042-b27d-54c8db6dffc7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:47.680529 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-12fa5825-0f8c-4042-b27d-54c8db6dffc7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:47.681300 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-12fa5825-0f8c-4042-b27d-54c8db6dffc7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:47.681819 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-12fa5825-0f8c-4042-b27d-54c8db6dffc7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:47.810078 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-12fa5825-0f8c-4042-b27d-54c8db6dffc7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:47.818659 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-12fa5825-0f8c-4042-b27d-54c8db6dffc7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:47.820161 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-12fa5825-0f8c-4042-b27d-54c8db6dffc7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:47.821309 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-12fa5825-0f8c-4042-b27d-54c8db6dffc7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.151933 Nov 08 16:17:47.821895 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 514/1037] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:47 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:48.413875 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-53571915-daec-49c9-ab0d-397ff6ca45da tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:48.414481 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-53571915-daec-49c9-ab0d-397ff6ca45da tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:48.420790 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-53571915-daec-49c9-ab0d-397ff6ca45da tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:48.421245 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-53571915-daec-49c9-ab0d-397ff6ca45da tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:48.422047 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-53571915-daec-49c9-ab0d-397ff6ca45da tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:48.422483 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-53571915-daec-49c9-ab0d-397ff6ca45da tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:48.560295 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-53571915-daec-49c9-ab0d-397ff6ca45da tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:48.568685 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-53571915-daec-49c9-ab0d-397ff6ca45da tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.158536 Nov 08 16:17:48.569243 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 524/1038] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:48 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:48.839681 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3afc37f9-d0de-40bf-b09d-8d7914af2983 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:48.840323 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3afc37f9-d0de-40bf-b09d-8d7914af2983 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:48.847377 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3afc37f9-d0de-40bf-b09d-8d7914af2983 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:48.848086 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3afc37f9-d0de-40bf-b09d-8d7914af2983 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:48.849128 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3afc37f9-d0de-40bf-b09d-8d7914af2983 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:48.849546 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3afc37f9-d0de-40bf-b09d-8d7914af2983 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:48.976578 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3afc37f9-d0de-40bf-b09d-8d7914af2983 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:48.984665 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3afc37f9-d0de-40bf-b09d-8d7914af2983 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:48.986181 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3afc37f9-d0de-40bf-b09d-8d7914af2983 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:48.987318 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3afc37f9-d0de-40bf-b09d-8d7914af2983 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.151372 Nov 08 16:17:48.987864 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 515/1039] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:48 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:49.585546 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-dbec133f-8ef9-4818-b936-24230321d9ea tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:49.586210 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-dbec133f-8ef9-4818-b936-24230321d9ea tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:49.592470 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dbec133f-8ef9-4818-b936-24230321d9ea tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:49.593511 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dbec133f-8ef9-4818-b936-24230321d9ea tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:49.594311 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dbec133f-8ef9-4818-b936-24230321d9ea tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:49.594750 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dbec133f-8ef9-4818-b936-24230321d9ea tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:49.720995 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-dbec133f-8ef9-4818-b936-24230321d9ea tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:49.728170 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-dbec133f-8ef9-4818-b936-24230321d9ea tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.146286 Nov 08 16:17:49.728731 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 525/1040] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:49 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:50.006771 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-44d01086-9a23-4b17-b8db-e6e4eb498f1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:50.008169 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-44d01086-9a23-4b17-b8db-e6e4eb498f1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:50.025099 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-44d01086-9a23-4b17-b8db-e6e4eb498f1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:50.025099 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-44d01086-9a23-4b17-b8db-e6e4eb498f1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:50.025099 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-44d01086-9a23-4b17-b8db-e6e4eb498f1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:50.025099 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-44d01086-9a23-4b17-b8db-e6e4eb498f1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:50.153236 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-44d01086-9a23-4b17-b8db-e6e4eb498f1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:50.161943 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-44d01086-9a23-4b17-b8db-e6e4eb498f1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:50.163430 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-44d01086-9a23-4b17-b8db-e6e4eb498f1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:50.164784 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-44d01086-9a23-4b17-b8db-e6e4eb498f1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.162323 Nov 08 16:17:50.165679 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 516/1041] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:50 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:50.746024 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-fb583902-d6c3-49e6-99c9-931255eb5330 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:50.746603 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-fb583902-d6c3-49e6-99c9-931255eb5330 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:50.752956 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fb583902-d6c3-49e6-99c9-931255eb5330 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:50.753397 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fb583902-d6c3-49e6-99c9-931255eb5330 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:50.754213 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fb583902-d6c3-49e6-99c9-931255eb5330 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:50.754648 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fb583902-d6c3-49e6-99c9-931255eb5330 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:50.884471 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-fb583902-d6c3-49e6-99c9-931255eb5330 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:50.892286 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-fb583902-d6c3-49e6-99c9-931255eb5330 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.151139 Nov 08 16:17:50.892836 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 526/1042] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:50 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:51.183358 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-98c9bd64-7e21-44cd-a398-6ca32ef412f5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:51.183963 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-98c9bd64-7e21-44cd-a398-6ca32ef412f5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:51.190418 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-98c9bd64-7e21-44cd-a398-6ca32ef412f5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:51.190861 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-98c9bd64-7e21-44cd-a398-6ca32ef412f5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:51.191824 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-98c9bd64-7e21-44cd-a398-6ca32ef412f5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:51.192421 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-98c9bd64-7e21-44cd-a398-6ca32ef412f5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:51.329076 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-98c9bd64-7e21-44cd-a398-6ca32ef412f5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:51.337996 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-98c9bd64-7e21-44cd-a398-6ca32ef412f5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:51.339420 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-98c9bd64-7e21-44cd-a398-6ca32ef412f5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:51.340614 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-98c9bd64-7e21-44cd-a398-6ca32ef412f5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.160985 Nov 08 16:17:51.341182 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 517/1043] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:51 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:51.908323 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a3aab1e9-fa80-42bf-992c-840f217f4374 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:51.908900 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a3aab1e9-fa80-42bf-992c-840f217f4374 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:51.915357 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a3aab1e9-fa80-42bf-992c-840f217f4374 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:51.915812 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a3aab1e9-fa80-42bf-992c-840f217f4374 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:51.916581 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a3aab1e9-fa80-42bf-992c-840f217f4374 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:51.917046 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a3aab1e9-fa80-42bf-992c-840f217f4374 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:52.042226 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a3aab1e9-fa80-42bf-992c-840f217f4374 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:52.049890 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a3aab1e9-fa80-42bf-992c-840f217f4374 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.145319 Nov 08 16:17:52.050438 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 527/1044] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:51 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:52.360100 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d5f97a94-42f1-4720-9903-c2c263c4088f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:52.360728 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d5f97a94-42f1-4720-9903-c2c263c4088f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:52.367076 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5f97a94-42f1-4720-9903-c2c263c4088f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:52.367520 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5f97a94-42f1-4720-9903-c2c263c4088f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:52.368293 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5f97a94-42f1-4720-9903-c2c263c4088f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:52.368723 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d5f97a94-42f1-4720-9903-c2c263c4088f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:52.501116 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d5f97a94-42f1-4720-9903-c2c263c4088f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:52.509330 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d5f97a94-42f1-4720-9903-c2c263c4088f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:52.510867 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d5f97a94-42f1-4720-9903-c2c263c4088f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:52.512020 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d5f97a94-42f1-4720-9903-c2c263c4088f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.156404 Nov 08 16:17:52.512566 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 518/1045] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:52 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:53.066899 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9c5bcc15-1d7d-4d24-8319-c9350f740d56 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:53.067507 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9c5bcc15-1d7d-4d24-8319-c9350f740d56 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:53.073866 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9c5bcc15-1d7d-4d24-8319-c9350f740d56 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:53.074312 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9c5bcc15-1d7d-4d24-8319-c9350f740d56 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:53.075087 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9c5bcc15-1d7d-4d24-8319-c9350f740d56 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:53.075516 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9c5bcc15-1d7d-4d24-8319-c9350f740d56 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:53.211780 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-9c5bcc15-1d7d-4d24-8319-c9350f740d56 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:53.219679 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9c5bcc15-1d7d-4d24-8319-c9350f740d56 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.156407 Nov 08 16:17:53.220434 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 528/1046] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:53 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:53.531062 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ac9671c8-1ebd-49a3-a611-09f34af6efaa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:53.531685 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ac9671c8-1ebd-49a3-a611-09f34af6efaa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:53.537896 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ac9671c8-1ebd-49a3-a611-09f34af6efaa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:53.538334 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ac9671c8-1ebd-49a3-a611-09f34af6efaa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:53.539091 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ac9671c8-1ebd-49a3-a611-09f34af6efaa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:53.539512 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ac9671c8-1ebd-49a3-a611-09f34af6efaa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:53.666479 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ac9671c8-1ebd-49a3-a611-09f34af6efaa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:53.675128 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ac9671c8-1ebd-49a3-a611-09f34af6efaa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:53.676600 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ac9671c8-1ebd-49a3-a611-09f34af6efaa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:53.677758 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ac9671c8-1ebd-49a3-a611-09f34af6efaa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.151060 Nov 08 16:17:53.678306 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 519/1047] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:53 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:54.236761 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d9a8f381-d9bb-4e4f-8035-72fac12afb5c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:54.237445 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d9a8f381-d9bb-4e4f-8035-72fac12afb5c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:54.243732 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d9a8f381-d9bb-4e4f-8035-72fac12afb5c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:54.244182 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d9a8f381-d9bb-4e4f-8035-72fac12afb5c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:54.245251 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d9a8f381-d9bb-4e4f-8035-72fac12afb5c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:54.245661 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d9a8f381-d9bb-4e4f-8035-72fac12afb5c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:54.382403 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-d9a8f381-d9bb-4e4f-8035-72fac12afb5c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:54.390759 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d9a8f381-d9bb-4e4f-8035-72fac12afb5c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.158199 Nov 08 16:17:54.391319 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 529/1048] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:54 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:54.695415 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8c4944fd-4a52-43e8-b966-ffed1857dc72 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:54.696004 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8c4944fd-4a52-43e8-b966-ffed1857dc72 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:54.702618 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8c4944fd-4a52-43e8-b966-ffed1857dc72 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:54.703055 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8c4944fd-4a52-43e8-b966-ffed1857dc72 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:54.703818 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8c4944fd-4a52-43e8-b966-ffed1857dc72 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:54.704243 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8c4944fd-4a52-43e8-b966-ffed1857dc72 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:54.835519 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8c4944fd-4a52-43e8-b966-ffed1857dc72 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:54.844282 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8c4944fd-4a52-43e8-b966-ffed1857dc72 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:54.845807 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8c4944fd-4a52-43e8-b966-ffed1857dc72 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:54.846974 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8c4944fd-4a52-43e8-b966-ffed1857dc72 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.155181 Nov 08 16:17:54.847525 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 520/1049] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:54 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:55.410637 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-75bd6b81-b03f-46ed-8838-4889064a8640 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:55.411191 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-75bd6b81-b03f-46ed-8838-4889064a8640 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:55.417699 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-75bd6b81-b03f-46ed-8838-4889064a8640 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:55.418178 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-75bd6b81-b03f-46ed-8838-4889064a8640 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:55.418955 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-75bd6b81-b03f-46ed-8838-4889064a8640 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:55.419386 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-75bd6b81-b03f-46ed-8838-4889064a8640 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:55.552731 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-75bd6b81-b03f-46ed-8838-4889064a8640 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:55.560939 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-75bd6b81-b03f-46ed-8838-4889064a8640 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.153927 Nov 08 16:17:55.561751 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 530/1050] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:55 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:55.865550 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-7515d04a-33b2-47b1-87dd-314801a82000 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:55.866199 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-7515d04a-33b2-47b1-87dd-314801a82000 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:55.872672 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7515d04a-33b2-47b1-87dd-314801a82000 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:55.873112 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7515d04a-33b2-47b1-87dd-314801a82000 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:55.873925 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7515d04a-33b2-47b1-87dd-314801a82000 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:55.874354 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7515d04a-33b2-47b1-87dd-314801a82000 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:56.000487 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7515d04a-33b2-47b1-87dd-314801a82000 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:56.008587 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7515d04a-33b2-47b1-87dd-314801a82000 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:56.010107 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7515d04a-33b2-47b1-87dd-314801a82000 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:56.011255 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-7515d04a-33b2-47b1-87dd-314801a82000 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.149508 Nov 08 16:17:56.011803 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 521/1051] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:55 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:56.578100 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-559e8071-9b8e-4834-b5ee-5c68061ce285 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:56.578734 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-559e8071-9b8e-4834-b5ee-5c68061ce285 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:56.584881 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-559e8071-9b8e-4834-b5ee-5c68061ce285 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:56.585336 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-559e8071-9b8e-4834-b5ee-5c68061ce285 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:56.586125 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-559e8071-9b8e-4834-b5ee-5c68061ce285 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:56.586553 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-559e8071-9b8e-4834-b5ee-5c68061ce285 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:56.722369 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-559e8071-9b8e-4834-b5ee-5c68061ce285 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:56.729835 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-559e8071-9b8e-4834-b5ee-5c68061ce285 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.156027 Nov 08 16:17:56.730410 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 531/1052] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:56 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:57.028509 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e44fe44d-0839-4119-863b-8debaab0f304 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:57.029184 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e44fe44d-0839-4119-863b-8debaab0f304 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:57.035852 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e44fe44d-0839-4119-863b-8debaab0f304 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:57.036287 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e44fe44d-0839-4119-863b-8debaab0f304 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:57.037048 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e44fe44d-0839-4119-863b-8debaab0f304 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:57.037471 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e44fe44d-0839-4119-863b-8debaab0f304 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:57.167695 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-e44fe44d-0839-4119-863b-8debaab0f304 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:57.175737 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-e44fe44d-0839-4119-863b-8debaab0f304 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:57.177211 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-e44fe44d-0839-4119-863b-8debaab0f304 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:57.178377 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e44fe44d-0839-4119-863b-8debaab0f304 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.153600 Nov 08 16:17:57.178950 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 522/1053] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:57 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:57.746833 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f0885011-706b-4ffc-9d35-1541b2c9d95e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:57.747446 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f0885011-706b-4ffc-9d35-1541b2c9d95e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:57.754243 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f0885011-706b-4ffc-9d35-1541b2c9d95e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:57.754705 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f0885011-706b-4ffc-9d35-1541b2c9d95e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:57.756024 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f0885011-706b-4ffc-9d35-1541b2c9d95e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:57.756526 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f0885011-706b-4ffc-9d35-1541b2c9d95e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:57.954768 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f0885011-706b-4ffc-9d35-1541b2c9d95e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:57.962022 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f0885011-706b-4ffc-9d35-1541b2c9d95e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.219193 Nov 08 16:17:57.963309 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 532/1054] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:57 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:17:58.196048 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-fbd6062d-6a02-4524-a2af-8ce8b549f602 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:58.198619 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fbd6062d-6a02-4524-a2af-8ce8b549f602 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:58.204684 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fbd6062d-6a02-4524-a2af-8ce8b549f602 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:58.205480 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fbd6062d-6a02-4524-a2af-8ce8b549f602 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:58.206304 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fbd6062d-6a02-4524-a2af-8ce8b549f602 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:58.206735 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fbd6062d-6a02-4524-a2af-8ce8b549f602 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:58.385676 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-dcadce82-5278-4444-9c79-2a076722a644 req-fd5e3996-e6dd-4dfa-b76f-cd7abf525d21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:17:58.387925 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:17:58.387925 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:17:58.397314 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-dcadce82-5278-4444-9c79-2a076722a644 req-fd5e3996-e6dd-4dfa-b76f-cd7abf525d21 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:58.397938 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-dcadce82-5278-4444-9c79-2a076722a644 req-fd5e3996-e6dd-4dfa-b76f-cd7abf525d21 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:58.410612 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-dcadce82-5278-4444-9c79-2a076722a644 req-fd5e3996-e6dd-4dfa-b76f-cd7abf525d21 service nova] Creating event network-changed:304e385a-c4e3-48f0-8723-230b5da69dc3 for instance 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 on hv-cinder-81618 Nov 08 16:17:58.418776 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-dcadce82-5278-4444-9c79-2a076722a644 req-fd5e3996-e6dd-4dfa-b76f-cd7abf525d21 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183000 Nov 08 16:17:58.420227 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 533/1055] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:17:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:17:58.498526 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fbd6062d-6a02-4524-a2af-8ce8b549f602 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:58.507587 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fbd6062d-6a02-4524-a2af-8ce8b549f602 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:58.509167 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fbd6062d-6a02-4524-a2af-8ce8b549f602 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:58.510364 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-fbd6062d-6a02-4524-a2af-8ce8b549f602 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.317978 Nov 08 16:17:58.510911 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 523/1056] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:58 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:17:58.979965 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-960c39a2-e29f-483a-9232-609a19d9a81c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:58.980832 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-960c39a2-e29f-483a-9232-609a19d9a81c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:58.987896 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-960c39a2-e29f-483a-9232-609a19d9a81c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:58.988352 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-960c39a2-e29f-483a-9232-609a19d9a81c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:58.989138 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-960c39a2-e29f-483a-9232-609a19d9a81c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:58.989578 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-960c39a2-e29f-483a-9232-609a19d9a81c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:59.195699 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-960c39a2-e29f-483a-9232-609a19d9a81c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:59.203597 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-960c39a2-e29f-483a-9232-609a19d9a81c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.227792 Nov 08 16:17:59.204239 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 534/1057] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:17:58 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:17:59.529125 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5b8d68e1-9585-4245-b8fd-fb8a7c4ec799 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:17:59.529742 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5b8d68e1-9585-4245-b8fd-fb8a7c4ec799 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:17:59.535984 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b8d68e1-9585-4245-b8fd-fb8a7c4ec799 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:59.536420 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b8d68e1-9585-4245-b8fd-fb8a7c4ec799 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:59.537185 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b8d68e1-9585-4245-b8fd-fb8a7c4ec799 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:17:59.537609 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5b8d68e1-9585-4245-b8fd-fb8a7c4ec799 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:17:59.666803 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-5b8d68e1-9585-4245-b8fd-fb8a7c4ec799 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:59.674949 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-5b8d68e1-9585-4245-b8fd-fb8a7c4ec799 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:59.676437 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-5b8d68e1-9585-4245-b8fd-fb8a7c4ec799 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:17:59.677611 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5b8d68e1-9585-4245-b8fd-fb8a7c4ec799 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.152274 Nov 08 16:17:59.678189 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 524/1058] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:17:59 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:18:00.221012 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-cb5bee1d-bcea-4967-8873-174328d734af tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:00.221614 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-cb5bee1d-bcea-4967-8873-174328d734af tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:00.228061 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cb5bee1d-bcea-4967-8873-174328d734af tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:00.228521 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cb5bee1d-bcea-4967-8873-174328d734af tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:00.229294 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cb5bee1d-bcea-4967-8873-174328d734af tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:00.229758 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cb5bee1d-bcea-4967-8873-174328d734af tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:00.353884 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-cb5bee1d-bcea-4967-8873-174328d734af tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:00.361593 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-cb5bee1d-bcea-4967-8873-174328d734af tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.145130 Nov 08 16:18:00.362177 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 535/1059] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:00 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:00.695878 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8e4ed3fd-c1de-42d9-a3a9-0b98112a6b61 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:00.696403 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8e4ed3fd-c1de-42d9-a3a9-0b98112a6b61 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:00.702600 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8e4ed3fd-c1de-42d9-a3a9-0b98112a6b61 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:00.703033 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8e4ed3fd-c1de-42d9-a3a9-0b98112a6b61 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:00.703788 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8e4ed3fd-c1de-42d9-a3a9-0b98112a6b61 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:00.704208 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8e4ed3fd-c1de-42d9-a3a9-0b98112a6b61 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:00.834384 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8e4ed3fd-c1de-42d9-a3a9-0b98112a6b61 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:00.842848 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8e4ed3fd-c1de-42d9-a3a9-0b98112a6b61 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:00.844325 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8e4ed3fd-c1de-42d9-a3a9-0b98112a6b61 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:00.845780 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8e4ed3fd-c1de-42d9-a3a9-0b98112a6b61 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.153458 Nov 08 16:18:00.846504 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 525/1060] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:18:00 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:18:01.378840 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1189a1ba-b237-4600-95fa-96fa7a6c366e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:01.379360 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1189a1ba-b237-4600-95fa-96fa7a6c366e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:01.385616 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1189a1ba-b237-4600-95fa-96fa7a6c366e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:01.386089 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1189a1ba-b237-4600-95fa-96fa7a6c366e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:01.386859 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1189a1ba-b237-4600-95fa-96fa7a6c366e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:01.387296 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1189a1ba-b237-4600-95fa-96fa7a6c366e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:01.519273 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1189a1ba-b237-4600-95fa-96fa7a6c366e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:01.526540 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1189a1ba-b237-4600-95fa-96fa7a6c366e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.151447 Nov 08 16:18:01.527108 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 536/1061] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:01 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:01.864352 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-19c0638d-4c56-4657-af5b-f3dca61618b1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:01.864956 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-19c0638d-4c56-4657-af5b-f3dca61618b1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:01.871421 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-19c0638d-4c56-4657-af5b-f3dca61618b1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:01.871866 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-19c0638d-4c56-4657-af5b-f3dca61618b1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:01.872636 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-19c0638d-4c56-4657-af5b-f3dca61618b1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:01.873067 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-19c0638d-4c56-4657-af5b-f3dca61618b1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:01.999850 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-19c0638d-4c56-4657-af5b-f3dca61618b1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:02.007886 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-19c0638d-4c56-4657-af5b-f3dca61618b1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:02.009378 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-19c0638d-4c56-4657-af5b-f3dca61618b1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:02.010559 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-19c0638d-4c56-4657-af5b-f3dca61618b1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.149979 Nov 08 16:18:02.011109 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 526/1062] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:18:01 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:18:02.542727 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-16b27e2d-9b46-498d-8f5c-92f37cd372f3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:02.543328 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-16b27e2d-9b46-498d-8f5c-92f37cd372f3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:02.549428 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-16b27e2d-9b46-498d-8f5c-92f37cd372f3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:02.549912 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-16b27e2d-9b46-498d-8f5c-92f37cd372f3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:02.550676 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-16b27e2d-9b46-498d-8f5c-92f37cd372f3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:02.551110 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-16b27e2d-9b46-498d-8f5c-92f37cd372f3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:02.675849 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-16b27e2d-9b46-498d-8f5c-92f37cd372f3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:02.683083 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-16b27e2d-9b46-498d-8f5c-92f37cd372f3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.144036 Nov 08 16:18:02.683636 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 537/1063] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:02 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:03.028092 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-fcc95ff4-c3db-47a3-b292-9bc1af8c0c47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:03.028750 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fcc95ff4-c3db-47a3-b292-9bc1af8c0c47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:03.035657 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fcc95ff4-c3db-47a3-b292-9bc1af8c0c47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:03.036104 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fcc95ff4-c3db-47a3-b292-9bc1af8c0c47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:03.036879 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fcc95ff4-c3db-47a3-b292-9bc1af8c0c47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:03.037317 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fcc95ff4-c3db-47a3-b292-9bc1af8c0c47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:03.166437 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fcc95ff4-c3db-47a3-b292-9bc1af8c0c47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:03.174540 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fcc95ff4-c3db-47a3-b292-9bc1af8c0c47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:03.176039 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fcc95ff4-c3db-47a3-b292-9bc1af8c0c47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:03.177194 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-fcc95ff4-c3db-47a3-b292-9bc1af8c0c47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.152797 Nov 08 16:18:03.177759 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 527/1064] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:18:03 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:18:03.700496 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c76686d1-1d3b-4a13-bdee-dc17893706ea tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:03.701157 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c76686d1-1d3b-4a13-bdee-dc17893706ea tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:03.707348 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c76686d1-1d3b-4a13-bdee-dc17893706ea tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:03.707797 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c76686d1-1d3b-4a13-bdee-dc17893706ea tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:03.708564 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c76686d1-1d3b-4a13-bdee-dc17893706ea tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:03.708997 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c76686d1-1d3b-4a13-bdee-dc17893706ea tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:03.851159 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c76686d1-1d3b-4a13-bdee-dc17893706ea tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:03.858990 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c76686d1-1d3b-4a13-bdee-dc17893706ea tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.162605 Nov 08 16:18:03.859647 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 538/1065] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:03 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:04.194435 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-277a8e34-2774-404a-9bd5-d02afaf945af tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:04.195031 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-277a8e34-2774-404a-9bd5-d02afaf945af tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:04.201348 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-277a8e34-2774-404a-9bd5-d02afaf945af tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:04.201821 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-277a8e34-2774-404a-9bd5-d02afaf945af tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:04.202598 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-277a8e34-2774-404a-9bd5-d02afaf945af tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:04.203063 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-277a8e34-2774-404a-9bd5-d02afaf945af tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:04.333733 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-277a8e34-2774-404a-9bd5-d02afaf945af tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:04.342558 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-277a8e34-2774-404a-9bd5-d02afaf945af tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:04.343876 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-277a8e34-2774-404a-9bd5-d02afaf945af tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:04.345024 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-277a8e34-2774-404a-9bd5-d02afaf945af tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.154258 Nov 08 16:18:04.345578 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 528/1066] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:18:04 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:18:04.875758 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d221754d-b8e4-4882-8409-f5e20ce4f1f8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:04.876362 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d221754d-b8e4-4882-8409-f5e20ce4f1f8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:04.886467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d221754d-b8e4-4882-8409-f5e20ce4f1f8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:04.886467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d221754d-b8e4-4882-8409-f5e20ce4f1f8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:04.886467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d221754d-b8e4-4882-8409-f5e20ce4f1f8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:04.886467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d221754d-b8e4-4882-8409-f5e20ce4f1f8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:05.018888 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-d221754d-b8e4-4882-8409-f5e20ce4f1f8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:05.028396 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d221754d-b8e4-4882-8409-f5e20ce4f1f8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.156658 Nov 08 16:18:05.029033 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 539/1067] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:04 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:05.363510 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-98389fb1-09cd-4804-b46b-5eadcdd05b71 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:05.364107 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-98389fb1-09cd-4804-b46b-5eadcdd05b71 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:05.370483 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-98389fb1-09cd-4804-b46b-5eadcdd05b71 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:05.370926 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-98389fb1-09cd-4804-b46b-5eadcdd05b71 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:05.371686 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-98389fb1-09cd-4804-b46b-5eadcdd05b71 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:05.372114 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-98389fb1-09cd-4804-b46b-5eadcdd05b71 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:05.503282 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-98389fb1-09cd-4804-b46b-5eadcdd05b71 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:05.511495 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-98389fb1-09cd-4804-b46b-5eadcdd05b71 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:05.512993 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-98389fb1-09cd-4804-b46b-5eadcdd05b71 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:05.514320 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-98389fb1-09cd-4804-b46b-5eadcdd05b71 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.154482 Nov 08 16:18:05.514871 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 529/1068] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:18:05 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:18:06.045467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-660896aa-5044-466b-bb73-c5dd31dd6640 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:06.046098 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-660896aa-5044-466b-bb73-c5dd31dd6640 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:06.052658 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-660896aa-5044-466b-bb73-c5dd31dd6640 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:06.053555 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-660896aa-5044-466b-bb73-c5dd31dd6640 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:06.054231 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-660896aa-5044-466b-bb73-c5dd31dd6640 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:06.054659 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-660896aa-5044-466b-bb73-c5dd31dd6640 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:06.201749 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-660896aa-5044-466b-bb73-c5dd31dd6640 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:06.209218 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-660896aa-5044-466b-bb73-c5dd31dd6640 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.167352 Nov 08 16:18:06.209990 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 540/1069] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:06 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:06.445964 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 16:18:06.446490 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: Mon Nov 8 16:18:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 16:18:06.531509 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-99892a44-1aff-4520-98f4-4953fe96208c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:06.532103 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-99892a44-1aff-4520-98f4-4953fe96208c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:06.538382 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-99892a44-1aff-4520-98f4-4953fe96208c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:06.538812 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-99892a44-1aff-4520-98f4-4953fe96208c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:06.539577 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-99892a44-1aff-4520-98f4-4953fe96208c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:06.540001 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-99892a44-1aff-4520-98f4-4953fe96208c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:06.669288 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-99892a44-1aff-4520-98f4-4953fe96208c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:06.678015 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-99892a44-1aff-4520-98f4-4953fe96208c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:06.679532 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-99892a44-1aff-4520-98f4-4953fe96208c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:06.680676 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-99892a44-1aff-4520-98f4-4953fe96208c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.152857 Nov 08 16:18:06.681225 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 530/1070] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:18:06 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:18:07.226641 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2d57a918-1317-4f5c-9a08-a161e1e1c9c0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:07.227352 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2d57a918-1317-4f5c-9a08-a161e1e1c9c0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:07.234239 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2d57a918-1317-4f5c-9a08-a161e1e1c9c0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:07.234688 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2d57a918-1317-4f5c-9a08-a161e1e1c9c0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:07.235462 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2d57a918-1317-4f5c-9a08-a161e1e1c9c0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:07.235898 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2d57a918-1317-4f5c-9a08-a161e1e1c9c0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:07.381949 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-2d57a918-1317-4f5c-9a08-a161e1e1c9c0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:07.390930 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2d57a918-1317-4f5c-9a08-a161e1e1c9c0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.167516 Nov 08 16:18:07.391364 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 541/1071] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:07 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:07.698946 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-eee7214b-2c30-42c3-8bf5-723480860660 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:07.699643 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-eee7214b-2c30-42c3-8bf5-723480860660 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:07.705762 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eee7214b-2c30-42c3-8bf5-723480860660 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:07.706206 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eee7214b-2c30-42c3-8bf5-723480860660 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:07.706971 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eee7214b-2c30-42c3-8bf5-723480860660 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:07.707394 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-eee7214b-2c30-42c3-8bf5-723480860660 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:07.842573 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-eee7214b-2c30-42c3-8bf5-723480860660 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:07.852346 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-eee7214b-2c30-42c3-8bf5-723480860660 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:07.854231 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-eee7214b-2c30-42c3-8bf5-723480860660 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:07.855354 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-eee7214b-2c30-42c3-8bf5-723480860660 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.160085 Nov 08 16:18:07.856031 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 531/1072] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:18:07 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:18:08.080029 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-c881cf41-97b9-4110-acf4-3d1d0560241f req-e97512ad-1ed3-4c27-ad5a-36b6259937d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "name": "network-vif-plugged", "status": "completed", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:18:08.084306 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:18:08.084306 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:18:08.093862 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-c881cf41-97b9-4110-acf4-3d1d0560241f req-e97512ad-1ed3-4c27-ad5a-36b6259937d5 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:08.094331 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-c881cf41-97b9-4110-acf4-3d1d0560241f req-e97512ad-1ed3-4c27-ad5a-36b6259937d5 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:08.105915 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-c881cf41-97b9-4110-acf4-3d1d0560241f req-e97512ad-1ed3-4c27-ad5a-36b6259937d5 service nova] Creating event network-vif-plugged:304e385a-c4e3-48f0-8723-230b5da69dc3 for instance 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 on hv-cinder-81618 Nov 08 16:18:08.111991 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-c881cf41-97b9-4110-acf4-3d1d0560241f req-e97512ad-1ed3-4c27-ad5a-36b6259937d5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036093 Nov 08 16:18:08.112790 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 542/1073] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:18:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:18:08.406203 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-52670345-f5fe-4102-a449-92c7550a95df tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:08.406846 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-52670345-f5fe-4102-a449-92c7550a95df tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:08.412664 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-52670345-f5fe-4102-a449-92c7550a95df tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:08.413118 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-52670345-f5fe-4102-a449-92c7550a95df tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:08.413919 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-52670345-f5fe-4102-a449-92c7550a95df tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:08.414357 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-52670345-f5fe-4102-a449-92c7550a95df tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:08.550439 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-52670345-f5fe-4102-a449-92c7550a95df tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:08.558056 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-52670345-f5fe-4102-a449-92c7550a95df tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.155441 Nov 08 16:18:08.558752 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 532/1074] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:08 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:08.874898 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3a6b8c0f-d904-45ff-bd2b-396c73fb206a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:08.875783 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3a6b8c0f-d904-45ff-bd2b-396c73fb206a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:08.882365 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3a6b8c0f-d904-45ff-bd2b-396c73fb206a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:08.882889 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3a6b8c0f-d904-45ff-bd2b-396c73fb206a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:08.883669 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3a6b8c0f-d904-45ff-bd2b-396c73fb206a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:08.884104 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3a6b8c0f-d904-45ff-bd2b-396c73fb206a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:09.021518 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-3a6b8c0f-d904-45ff-bd2b-396c73fb206a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:09.030249 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-3a6b8c0f-d904-45ff-bd2b-396c73fb206a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:09.031741 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-3a6b8c0f-d904-45ff-bd2b-396c73fb206a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:09.032889 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3a6b8c0f-d904-45ff-bd2b-396c73fb206a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.162601 Nov 08 16:18:09.033435 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 543/1075] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:18:08 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:18:09.574489 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e67da97c-e301-4601-b764-c21474381b77 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:09.575113 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e67da97c-e301-4601-b764-c21474381b77 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:09.582011 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e67da97c-e301-4601-b764-c21474381b77 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:09.582445 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e67da97c-e301-4601-b764-c21474381b77 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:09.583203 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e67da97c-e301-4601-b764-c21474381b77 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:09.583624 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e67da97c-e301-4601-b764-c21474381b77 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:09.716209 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-e67da97c-e301-4601-b764-c21474381b77 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:09.724026 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e67da97c-e301-4601-b764-c21474381b77 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1358 microversion: 2.1 time: 0.153108 Nov 08 16:18:09.724589 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 533/1076] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:09 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:10.051147 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9ff42677-f5dc-4909-b1a7-087aa7664197 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:10.051757 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9ff42677-f5dc-4909-b1a7-087aa7664197 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:10.058013 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ff42677-f5dc-4909-b1a7-087aa7664197 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:10.058469 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ff42677-f5dc-4909-b1a7-087aa7664197 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:10.059249 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ff42677-f5dc-4909-b1a7-087aa7664197 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:10.059687 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ff42677-f5dc-4909-b1a7-087aa7664197 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:10.127993 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-4e59b39f-57d8-4243-ab6a-b4a5fb51b2c9 req-a82daf46-07bb-4faa-a41f-df67d3a5ee05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "name": "network-vif-plugged", "status": "completed", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:18:10.129564 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:18:10.129564 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:18:10.136275 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-4e59b39f-57d8-4243-ab6a-b4a5fb51b2c9 req-a82daf46-07bb-4faa-a41f-df67d3a5ee05 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:10.136706 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-4e59b39f-57d8-4243-ab6a-b4a5fb51b2c9 req-a82daf46-07bb-4faa-a41f-df67d3a5ee05 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:10.147380 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-4e59b39f-57d8-4243-ab6a-b4a5fb51b2c9 req-a82daf46-07bb-4faa-a41f-df67d3a5ee05 service nova] Creating event network-vif-plugged:fbefda08-fc7a-42a0-b714-6dea3d8a5161 for instance 1c1c8c8d-5f78-45fb-803d-8f7a84df3433 on hv-cinder-81618 Nov 08 16:18:10.152502 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-4e59b39f-57d8-4243-ab6a-b4a5fb51b2c9 req-a82daf46-07bb-4faa-a41f-df67d3a5ee05 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028109 Nov 08 16:18:10.153325 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 534/1077] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:18:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:18:10.194405 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-9ff42677-f5dc-4909-b1a7-087aa7664197 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:10.202715 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-9ff42677-f5dc-4909-b1a7-087aa7664197 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:10.204535 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-9ff42677-f5dc-4909-b1a7-087aa7664197 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:10.206062 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9ff42677-f5dc-4909-b1a7-087aa7664197 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.158588 Nov 08 16:18:10.206614 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 544/1078] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:18:10 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:18:10.741116 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ae8bc26e-7c71-4794-ae97-b3d3a6324803 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:10.741974 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ae8bc26e-7c71-4794-ae97-b3d3a6324803 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:10.749176 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ae8bc26e-7c71-4794-ae97-b3d3a6324803 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:10.749620 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ae8bc26e-7c71-4794-ae97-b3d3a6324803 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:10.750427 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ae8bc26e-7c71-4794-ae97-b3d3a6324803 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:10.750860 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ae8bc26e-7c71-4794-ae97-b3d3a6324803 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:10.880178 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ae8bc26e-7c71-4794-ae97-b3d3a6324803 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:10.887438 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ae8bc26e-7c71-4794-ae97-b3d3a6324803 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1547 microversion: 2.1 time: 0.150813 Nov 08 16:18:10.887988 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 535/1079] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:10 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:10.903024 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-39f8537a-db72-4ba2-9a37-1a4d0767f76c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:10.903629 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-39f8537a-db72-4ba2-9a37-1a4d0767f76c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:10.909951 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-39f8537a-db72-4ba2-9a37-1a4d0767f76c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:10.910395 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-39f8537a-db72-4ba2-9a37-1a4d0767f76c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:10.911160 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-39f8537a-db72-4ba2-9a37-1a4d0767f76c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:10.911591 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-39f8537a-db72-4ba2-9a37-1a4d0767f76c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:11.039162 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-39f8537a-db72-4ba2-9a37-1a4d0767f76c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:11.047435 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-39f8537a-db72-4ba2-9a37-1a4d0767f76c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1547 microversion: 2.1 time: 0.147978 Nov 08 16:18:11.048005 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 545/1080] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:10 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:11.064582 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f3870b88-2de1-42f3-b3b4-2880692b3fc1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:11.067954 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:18:11.067954 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:18:11.068948 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f3870b88-2de1-42f3-b3b4-2880692b3fc1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:11.069687 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f3870b88-2de1-42f3-b3b4-2880692b3fc1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Searching by: {'deleted': False, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807'} {{(pid=115523) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 08 16:18:11.076407 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f3870b88-2de1-42f3-b3b4-2880692b3fc1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:11.076843 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f3870b88-2de1-42f3-b3b4-2880692b3fc1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:11.077642 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f3870b88-2de1-42f3-b3b4-2880692b3fc1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:11.078093 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f3870b88-2de1-42f3-b3b4-2880692b3fc1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:11.167259 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.multi_cell_list [None req-f3870b88-2de1-42f3-b3b4-2880692b3fc1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=115523) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 08 16:18:11.223622 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-95827ef6-3924-4474-b53d-e9ee57ffc4db tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:11.224625 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-95827ef6-3924-4474-b53d-e9ee57ffc4db tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:11.230821 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-95827ef6-3924-4474-b53d-e9ee57ffc4db tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:11.231374 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-95827ef6-3924-4474-b53d-e9ee57ffc4db tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:11.232353 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-95827ef6-3924-4474-b53d-e9ee57ffc4db tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:11.232885 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-95827ef6-3924-4474-b53d-e9ee57ffc4db tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:11.261973 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f3870b88-2de1-42f3-b3b4-2880692b3fc1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.201504 Nov 08 16:18:11.262828 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 536/1081] 10.222.0.37 () {58 vars in 1124 bytes} [Mon Nov 8 16:18:11 2021] GET /compute/v2.1/servers => generated 343 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:18:11.273174 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-652a011b-7a36-4b39-b5c8-5d26261ff8e2 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:11.273816 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-652a011b-7a36-4b39-b5c8-5d26261ff8e2 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:11.280203 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-652a011b-7a36-4b39-b5c8-5d26261ff8e2 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:11.280649 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-652a011b-7a36-4b39-b5c8-5d26261ff8e2 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:11.281440 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-652a011b-7a36-4b39-b5c8-5d26261ff8e2 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:11.281949 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-652a011b-7a36-4b39-b5c8-5d26261ff8e2 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:11.405987 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-95827ef6-3924-4474-b53d-e9ee57ffc4db tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:11.414463 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-95827ef6-3924-4474-b53d-e9ee57ffc4db tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:11.416284 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-95827ef6-3924-4474-b53d-e9ee57ffc4db tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:11.417624 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-95827ef6-3924-4474-b53d-e9ee57ffc4db tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.197695 Nov 08 16:18:11.418353 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 546/1082] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:18:11 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:18:11.452740 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-652a011b-7a36-4b39-b5c8-5d26261ff8e2 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:11.460286 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-652a011b-7a36-4b39-b5c8-5d26261ff8e2 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1547 microversion: 2.1 time: 0.190797 Nov 08 16:18:11.460969 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 537/1083] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:11 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1547 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:18:12.435704 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4784fc1e-5e78-4bfe-aaa9-513e8cd8a9d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:12.436477 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4784fc1e-5e78-4bfe-aaa9-513e8cd8a9d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:12.442803 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4784fc1e-5e78-4bfe-aaa9-513e8cd8a9d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:12.443246 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4784fc1e-5e78-4bfe-aaa9-513e8cd8a9d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:12.444001 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4784fc1e-5e78-4bfe-aaa9-513e8cd8a9d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:12.444438 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4784fc1e-5e78-4bfe-aaa9-513e8cd8a9d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:12.579435 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4784fc1e-5e78-4bfe-aaa9-513e8cd8a9d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:12.587635 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4784fc1e-5e78-4bfe-aaa9-513e8cd8a9d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:12.589136 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4784fc1e-5e78-4bfe-aaa9-513e8cd8a9d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:12.590330 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4784fc1e-5e78-4bfe-aaa9-513e8cd8a9d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1810 microversion: 2.20 time: 0.158351 Nov 08 16:18:12.590881 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 547/1084] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:18:12 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:18:12.994675 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b731aff7-f6e0-4464-85dd-44cd82af3826 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a57e3ac2-4ff9-4836-a58c-b2fee6890b38"}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:18:12.995824 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b731aff7-f6e0-4464-85dd-44cd82af3826 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:13.002230 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b731aff7-f6e0-4464-85dd-44cd82af3826 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:13.002745 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b731aff7-f6e0-4464-85dd-44cd82af3826 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:13.003703 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b731aff7-f6e0-4464-85dd-44cd82af3826 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:13.004159 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b731aff7-f6e0-4464-85dd-44cd82af3826 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:13.252288 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b731aff7-f6e0-4464-85dd-44cd82af3826 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "POST /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261467 Nov 08 16:18:13.254131 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 538/1085] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Nov 8 16:18:12 2021] POST /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:18:13.610009 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5aba2852-4c87-4166-8ead-e7b13280c5ab tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:13.610523 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5aba2852-4c87-4166-8ead-e7b13280c5ab tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:13.617003 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5aba2852-4c87-4166-8ead-e7b13280c5ab tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:13.617448 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5aba2852-4c87-4166-8ead-e7b13280c5ab tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:13.618244 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5aba2852-4c87-4166-8ead-e7b13280c5ab tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:13.618675 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5aba2852-4c87-4166-8ead-e7b13280c5ab tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:13.748052 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-5aba2852-4c87-4166-8ead-e7b13280c5ab tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:13.756366 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-5aba2852-4c87-4166-8ead-e7b13280c5ab tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:13.757890 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-5aba2852-4c87-4166-8ead-e7b13280c5ab tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:13.759054 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5aba2852-4c87-4166-8ead-e7b13280c5ab tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1797 microversion: 2.20 time: 0.153339 Nov 08 16:18:13.759609 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 548/1086] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:18:13 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1797 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:18:15.927318 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f02192ca-93c4-4215-97f3-6671a4c6d98b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:15.927894 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f02192ca-93c4-4215-97f3-6671a4c6d98b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:15.934219 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f02192ca-93c4-4215-97f3-6671a4c6d98b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:15.934655 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f02192ca-93c4-4215-97f3-6671a4c6d98b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:15.935476 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f02192ca-93c4-4215-97f3-6671a4c6d98b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:15.935899 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f02192ca-93c4-4215-97f3-6671a4c6d98b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:15.961052 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f02192ca-93c4-4215-97f3-6671a4c6d98b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Going to try to terminate instance {{(pid=115523) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:18:16.035860 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f02192ca-93c4-4215-97f3-6671a4c6d98b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "DELETE /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 204 len: 0 microversion: 2.1 time: 0.329653 Nov 08 16:18:16.036515 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 539/1087] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:18:15 2021] DELETE /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:18:16.044858 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-40c2228c-2d87-4ed4-8a3a-13d6261808fb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:16.045498 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-40c2228c-2d87-4ed4-8a3a-13d6261808fb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:16.051521 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-40c2228c-2d87-4ed4-8a3a-13d6261808fb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:16.051971 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-40c2228c-2d87-4ed4-8a3a-13d6261808fb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:16.052752 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-40c2228c-2d87-4ed4-8a3a-13d6261808fb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:16.053182 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-40c2228c-2d87-4ed4-8a3a-13d6261808fb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:16.186229 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-40c2228c-2d87-4ed4-8a3a-13d6261808fb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:16.193422 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-40c2228c-2d87-4ed4-8a3a-13d6261808fb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1579 microversion: 2.1 time: 0.152542 Nov 08 16:18:16.194021 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 549/1088] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:16 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:17.213184 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-23868b40-9fb6-406d-a599-2f60d0ce35a6 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:17.213970 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-23868b40-9fb6-406d-a599-2f60d0ce35a6 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:17.220795 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-23868b40-9fb6-406d-a599-2f60d0ce35a6 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:17.221229 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-23868b40-9fb6-406d-a599-2f60d0ce35a6 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:17.222041 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-23868b40-9fb6-406d-a599-2f60d0ce35a6 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:17.222467 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-23868b40-9fb6-406d-a599-2f60d0ce35a6 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:17.367171 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-23868b40-9fb6-406d-a599-2f60d0ce35a6 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:17.374595 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-23868b40-9fb6-406d-a599-2f60d0ce35a6 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1579 microversion: 2.1 time: 0.165420 Nov 08 16:18:17.375154 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 540/1089] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:17 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1579 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:18.391754 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-13c8bc82-d578-4e6c-989d-dd82ed7998a4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:18.392368 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-13c8bc82-d578-4e6c-989d-dd82ed7998a4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:18.399335 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-13c8bc82-d578-4e6c-989d-dd82ed7998a4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:18.399791 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-13c8bc82-d578-4e6c-989d-dd82ed7998a4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:18.400584 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-13c8bc82-d578-4e6c-989d-dd82ed7998a4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:18.401032 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-13c8bc82-d578-4e6c-989d-dd82ed7998a4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:18.831887 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-13c8bc82-d578-4e6c-989d-dd82ed7998a4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:18.839696 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-13c8bc82-d578-4e6c-989d-dd82ed7998a4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1579 microversion: 2.1 time: 0.451644 Nov 08 16:18:18.840528 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 550/1090] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:18 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1579 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:19.213072 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-810b2e9b-0d40-47bb-a2ce-42aaa6292629 req-1014c9d9-820b-4f5e-a650-bf97f0274830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d643b8f8-c205-49ba-8889-30842481b95f", "name": "network-vif-deleted", "tag": "17d7004d-111e-4cfc-904c-a17ed005bc2f"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:18:19.215251 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:18:19.215251 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:18:19.226382 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-810b2e9b-0d40-47bb-a2ce-42aaa6292629 req-1014c9d9-820b-4f5e-a650-bf97f0274830 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:19.226815 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-810b2e9b-0d40-47bb-a2ce-42aaa6292629 req-1014c9d9-820b-4f5e-a650-bf97f0274830 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:19.242925 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-810b2e9b-0d40-47bb-a2ce-42aaa6292629 req-1014c9d9-820b-4f5e-a650-bf97f0274830 service nova] Creating event network-vif-deleted:17d7004d-111e-4cfc-904c-a17ed005bc2f for instance d643b8f8-c205-49ba-8889-30842481b95f on hv-cinder-81618 Nov 08 16:18:19.251276 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-810b2e9b-0d40-47bb-a2ce-42aaa6292629 req-1014c9d9-820b-4f5e-a650-bf97f0274830 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041567 Nov 08 16:18:19.256399 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 541/1091] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:18:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:18:19.856530 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d045a7a4-f93a-401a-aef8-26f0b702b815 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:19.862360 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d045a7a4-f93a-401a-aef8-26f0b702b815 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:19.869057 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d045a7a4-f93a-401a-aef8-26f0b702b815 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:19.869942 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d045a7a4-f93a-401a-aef8-26f0b702b815 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:19.870960 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d045a7a4-f93a-401a-aef8-26f0b702b815 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:19.871456 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d045a7a4-f93a-401a-aef8-26f0b702b815 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:19.904054 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d045a7a4-f93a-401a-aef8-26f0b702b815 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:19.904496 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d045a7a4-f93a-401a-aef8-26f0b702b815 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:19.904946 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.objects.instance [None req-d045a7a4-f93a-401a-aef8-26f0b702b815 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lazy-loading 'fault' on Instance uuid d643b8f8-c205-49ba-8889-30842481b95f {{(pid=115524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:18:19.948235 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-d045a7a4-f93a-401a-aef8-26f0b702b815 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:19.958256 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d045a7a4-f93a-401a-aef8-26f0b702b815 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 200 len: 1231 microversion: 2.1 time: 0.105498 Nov 08 16:18:19.959395 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 551/1092] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:19 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:20.783987 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a2309cf4-6e7e-4e88-8727-79a8411dfec8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:20.784717 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a2309cf4-6e7e-4e88-8727-79a8411dfec8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:20.791421 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a2309cf4-6e7e-4e88-8727-79a8411dfec8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:20.791869 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a2309cf4-6e7e-4e88-8727-79a8411dfec8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:20.792669 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a2309cf4-6e7e-4e88-8727-79a8411dfec8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:20.793099 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a2309cf4-6e7e-4e88-8727-79a8411dfec8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:20.934588 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a2309cf4-6e7e-4e88-8727-79a8411dfec8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:20.943260 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a2309cf4-6e7e-4e88-8727-79a8411dfec8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1593 microversion: 2.1 time: 0.163139 Nov 08 16:18:20.943947 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 542/1093] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:20 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1593 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:20.976036 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-16317578-e9cf-4d47-a5b0-45fc7e04a2c1 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:20.976738 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-16317578-e9cf-4d47-a5b0-45fc7e04a2c1 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:20.983630 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-16317578-e9cf-4d47-a5b0-45fc7e04a2c1 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:20.984199 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-16317578-e9cf-4d47-a5b0-45fc7e04a2c1 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:20.985053 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-16317578-e9cf-4d47-a5b0-45fc7e04a2c1 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:20.985564 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-16317578-e9cf-4d47-a5b0-45fc7e04a2c1 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:20.999650 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-16317578-e9cf-4d47-a5b0-45fc7e04a2c1 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] HTTP exception thrown: Instance d643b8f8-c205-49ba-8889-30842481b95f could not be found. Nov 08 16:18:21.000272 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-16317578-e9cf-4d47-a5b0-45fc7e04a2c1 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Returning 404 to user: Instance d643b8f8-c205-49ba-8889-30842481b95f could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:18:21.001107 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-16317578-e9cf-4d47-a5b0-45fc7e04a2c1 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 404 len: 111 microversion: 2.1 time: 0.028744 Nov 08 16:18:21.009500 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 552/1094] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:20 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:18:21.100695 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-153425622", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1157858539", "security_groups": [{"name": "tempest-secgroup-smoke-706634952"}], "block_device_mapping_v2": [{"uuid": "0e05d3d6-0f1c-47f8-a3ab-4ba487169dfa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a15e051b-c130-4140-aaf2-a45ea7af5b43"}]}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:18:21.224646 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.network.neutron [None req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] validate_networks() for [('a15e051b-c130-4140-aaf2-a45ea7af5b43', None, None, None, None, None)] {{(pid=115523) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:18:21.800261 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Flavor limits 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:18:21.801308 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Image limits 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:18:21.801817 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Flavor pref 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:18:21.802217 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Image pref 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:18:21.802617 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:18:21.812084 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:21.812518 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:21.813309 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:21.813748 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:21.829491 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Getting quotas for project 343d5ca096394f87bea0950aa3811a13. Resources: {'instances', 'ram', 'cores'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:18:21.833330 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Getting quotas for user e81a95f368744b3eb9fd85a9c6e0c8ed and project 343d5ca096394f87bea0950aa3811a13. Resources: {'instances', 'ram', 'cores'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:18:21.891634 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Going to run 1 instances... {{(pid=115523) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:18:21.893946 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e05d3d6-0f1c-47f8-a3ab-4ba487169dfa',volume_size=None,volume_type=None)] {{(pid=115523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:18:22.019888 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.922802 Nov 08 16:18:22.021268 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 543/1095] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Nov 8 16:18:21 2021] POST /compute/v2.1/servers => generated 405 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 16:18:22.031313 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-38d62322-bb1b-40d4-b373-c7cf8d6fa7e4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:22.033027 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-38d62322-bb1b-40d4-b373-c7cf8d6fa7e4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:22.131818 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-38d62322-bb1b-40d4-b373-c7cf8d6fa7e4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:22.140937 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-38d62322-bb1b-40d4-b373-c7cf8d6fa7e4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 200 len: 1094 microversion: 2.1 time: 0.113683 Nov 08 16:18:22.141923 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 553/1096] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:22 2021] GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 1094 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:23.161485 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-86564482-038e-4b31-9626-606b5e6c7054 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:23.162128 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-86564482-038e-4b31-9626-606b5e6c7054 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:23.168500 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-86564482-038e-4b31-9626-606b5e6c7054 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:23.169136 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-86564482-038e-4b31-9626-606b5e6c7054 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:23.169972 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-86564482-038e-4b31-9626-606b5e6c7054 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:23.170400 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-86564482-038e-4b31-9626-606b5e6c7054 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:23.253441 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-86564482-038e-4b31-9626-606b5e6c7054 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:23.260669 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-86564482-038e-4b31-9626-606b5e6c7054 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 200 len: 1210 microversion: 2.1 time: 0.104123 Nov 08 16:18:23.261518 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 544/1097] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:23 2021] GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:23.545386 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-6178af08-179f-4ea3-ad2d-1e442c4e62f3 req-28fd891e-4f65-4730-aa15-e0bfdef1457a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:18:23.546995 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:18:23.546995 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:18:23.563324 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-6178af08-179f-4ea3-ad2d-1e442c4e62f3 req-28fd891e-4f65-4730-aa15-e0bfdef1457a service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:23.563859 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-6178af08-179f-4ea3-ad2d-1e442c4e62f3 req-28fd891e-4f65-4730-aa15-e0bfdef1457a service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:23.583436 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-6178af08-179f-4ea3-ad2d-1e442c4e62f3 req-28fd891e-4f65-4730-aa15-e0bfdef1457a service nova] Creating event network-changed:304e385a-c4e3-48f0-8723-230b5da69dc3 for instance 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 on hv-cinder-81618 Nov 08 16:18:23.589368 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-6178af08-179f-4ea3-ad2d-1e442c4e62f3 req-28fd891e-4f65-4730-aa15-e0bfdef1457a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047273 Nov 08 16:18:23.590529 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 554/1098] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:18:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:18:24.283484 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-19adf0ab-cf15-4742-bee0-7c56d12560cb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:24.288201 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-19adf0ab-cf15-4742-bee0-7c56d12560cb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:24.298243 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-19adf0ab-cf15-4742-bee0-7c56d12560cb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:24.300156 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-19adf0ab-cf15-4742-bee0-7c56d12560cb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:24.301335 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-19adf0ab-cf15-4742-bee0-7c56d12560cb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:24.302077 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-19adf0ab-cf15-4742-bee0-7c56d12560cb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:24.639032 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-19adf0ab-cf15-4742-bee0-7c56d12560cb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:24.648918 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-19adf0ab-cf15-4742-bee0-7c56d12560cb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 200 len: 1265 microversion: 2.1 time: 0.373784 Nov 08 16:18:24.650191 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 545/1099] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:24 2021] GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 1265 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:24.948310 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-efb4ed8a-e928-4199-8cb5-5e2ac2d2c6cf tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-265532524"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:18:24.949163 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-efb4ed8a-e928-4199-8cb5-5e2ac2d2c6cf tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:24.956952 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-efb4ed8a-e928-4199-8cb5-5e2ac2d2c6cf tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:24.957471 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-efb4ed8a-e928-4199-8cb5-5e2ac2d2c6cf tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:24.958362 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-efb4ed8a-e928-4199-8cb5-5e2ac2d2c6cf tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:24.958928 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-efb4ed8a-e928-4199-8cb5-5e2ac2d2c6cf tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:25.179395 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.network.security_group_api [None req-efb4ed8a-e928-4199-8cb5-5e2ac2d2c6cf tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Adding security group 1d27de4f-b93c-4054-9b9d-62a7c87a8620 to port 304e385a-c4e3-48f0-8723-230b5da69dc3 Nov 08 16:18:25.613317 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-5e1ef974-ecdf-4152-8a09-122585b64323 req-608a4d44-5ba2-437d-a3e7-4119a589f1af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ce49cb3-8d64-40a5-9827-64fa1d2f37c2", "tag": "794847db-0663-47ab-a2b0-4bdedb698598"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:18:25.614936 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:18:25.614936 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:18:25.622576 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-5e1ef974-ecdf-4152-8a09-122585b64323 req-608a4d44-5ba2-437d-a3e7-4119a589f1af service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:25.623012 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-5e1ef974-ecdf-4152-8a09-122585b64323 req-608a4d44-5ba2-437d-a3e7-4119a589f1af service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:25.633315 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-5e1ef974-ecdf-4152-8a09-122585b64323 req-608a4d44-5ba2-437d-a3e7-4119a589f1af service nova] Creating event network-changed:794847db-0663-47ab-a2b0-4bdedb698598 for instance 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 on hv-cinder-81618 Nov 08 16:18:25.638616 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-5e1ef974-ecdf-4152-8a09-122585b64323 req-608a4d44-5ba2-437d-a3e7-4119a589f1af service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028251 Nov 08 16:18:25.639198 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 546/1100] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:18:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:18:25.669731 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6046d95a-626f-4fb4-9e88-c42ead6f9d0a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:25.671130 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6046d95a-626f-4fb4-9e88-c42ead6f9d0a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:25.678232 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6046d95a-626f-4fb4-9e88-c42ead6f9d0a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:25.678686 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6046d95a-626f-4fb4-9e88-c42ead6f9d0a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:25.679528 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6046d95a-626f-4fb4-9e88-c42ead6f9d0a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:25.679960 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6046d95a-626f-4fb4-9e88-c42ead6f9d0a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:25.786310 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-efb4ed8a-e928-4199-8cb5-5e2ac2d2c6cf tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "POST /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912/action" status: 202 len: 0 microversion: 2.1 time: 0.842803 Nov 08 16:18:25.787464 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 555/1101] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:18:24 2021] POST /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912/action => generated 0 bytes in 845 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:18:25.795583 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-295328e1-ff86-41f9-ab47-da97334bf746 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:25.796513 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-295328e1-ff86-41f9-ab47-da97334bf746 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:25.803210 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-295328e1-ff86-41f9-ab47-da97334bf746 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:25.804186 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-295328e1-ff86-41f9-ab47-da97334bf746 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:25.805452 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-295328e1-ff86-41f9-ab47-da97334bf746 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:25.806311 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-295328e1-ff86-41f9-ab47-da97334bf746 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:25.965441 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6046d95a-626f-4fb4-9e88-c42ead6f9d0a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:25.975798 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6046d95a-626f-4fb4-9e88-c42ead6f9d0a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 200 len: 1265 microversion: 2.1 time: 0.312692 Nov 08 16:18:25.985953 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 547/1102] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:25 2021] GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 1265 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:18:26.070162 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-295328e1-ff86-41f9-ab47-da97334bf746 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:26.080162 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-295328e1-ff86-41f9-ab47-da97334bf746 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1758 microversion: 2.1 time: 0.288725 Nov 08 16:18:26.081446 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 556/1103] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:25 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1758 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:26.992763 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5ed8556f-f997-4ee4-8bea-9ea4658c08e8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:26.993393 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5ed8556f-f997-4ee4-8bea-9ea4658c08e8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:27.000460 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5ed8556f-f997-4ee4-8bea-9ea4658c08e8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:27.000898 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5ed8556f-f997-4ee4-8bea-9ea4658c08e8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:27.001658 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5ed8556f-f997-4ee4-8bea-9ea4658c08e8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:27.002109 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5ed8556f-f997-4ee4-8bea-9ea4658c08e8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:27.141732 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-5ed8556f-f997-4ee4-8bea-9ea4658c08e8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:27.148851 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5ed8556f-f997-4ee4-8bea-9ea4658c08e8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 200 len: 1265 microversion: 2.1 time: 0.159737 Nov 08 16:18:27.149437 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 548/1104] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:26 2021] GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:27.653392 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-577368a8-4428-4190-8fc1-695f65d445d7 req-3f75dafd-9af0-4111-8960-7800a4655625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:18:27.654892 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:18:27.654892 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:18:27.662086 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-577368a8-4428-4190-8fc1-695f65d445d7 req-3f75dafd-9af0-4111-8960-7800a4655625 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:27.662523 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-577368a8-4428-4190-8fc1-695f65d445d7 req-3f75dafd-9af0-4111-8960-7800a4655625 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:27.674099 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-577368a8-4428-4190-8fc1-695f65d445d7 req-3f75dafd-9af0-4111-8960-7800a4655625 service nova] Creating event network-changed:304e385a-c4e3-48f0-8723-230b5da69dc3 for instance 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 on hv-cinder-81618 Nov 08 16:18:27.679195 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-577368a8-4428-4190-8fc1-695f65d445d7 req-3f75dafd-9af0-4111-8960-7800a4655625 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029332 Nov 08 16:18:27.679858 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 557/1105] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:18:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:18:28.165797 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-fe61589f-0aaf-46df-88dc-1b6836f6180f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:28.166584 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fe61589f-0aaf-46df-88dc-1b6836f6180f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:28.173339 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fe61589f-0aaf-46df-88dc-1b6836f6180f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:28.173812 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fe61589f-0aaf-46df-88dc-1b6836f6180f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:28.174600 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fe61589f-0aaf-46df-88dc-1b6836f6180f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:28.175122 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fe61589f-0aaf-46df-88dc-1b6836f6180f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:28.304591 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fe61589f-0aaf-46df-88dc-1b6836f6180f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:28.311779 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-fe61589f-0aaf-46df-88dc-1b6836f6180f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 200 len: 1265 microversion: 2.1 time: 0.149670 Nov 08 16:18:28.312339 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 549/1106] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:28 2021] GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:29.017901 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f0260eda-72b3-4817-90d1-9d1d7caeed30 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:29.018607 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f0260eda-72b3-4817-90d1-9d1d7caeed30 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:29.025019 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f0260eda-72b3-4817-90d1-9d1d7caeed30 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:29.025468 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f0260eda-72b3-4817-90d1-9d1d7caeed30 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:29.026285 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f0260eda-72b3-4817-90d1-9d1d7caeed30 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:29.026711 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f0260eda-72b3-4817-90d1-9d1d7caeed30 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:29.103263 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.objects.instance [None req-f0260eda-72b3-4817-90d1-9d1d7caeed30 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lazy-loading 'services' on Instance uuid b76ed94d-63f4-4597-be02-f3fc032b85aa {{(pid=115524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:18:29.171117 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f0260eda-72b3-4817-90d1-9d1d7caeed30 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "DELETE /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/os-volume_attachments/29ed27a2-68df-4377-8ed6-55363d46dfbc" status: 202 len: 0 microversion: 2.1 time: 0.156832 Nov 08 16:18:29.171719 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 558/1107] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Nov 8 16:18:29 2021] DELETE /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/os-volume_attachments/29ed27a2-68df-4377-8ed6-55363d46dfbc => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:18:29.327809 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6ef852fc-52cb-4c29-87af-16477baa09fc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:29.328397 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6ef852fc-52cb-4c29-87af-16477baa09fc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:29.334544 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6ef852fc-52cb-4c29-87af-16477baa09fc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:29.334982 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6ef852fc-52cb-4c29-87af-16477baa09fc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:29.335735 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6ef852fc-52cb-4c29-87af-16477baa09fc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:29.336156 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6ef852fc-52cb-4c29-87af-16477baa09fc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:29.464840 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6ef852fc-52cb-4c29-87af-16477baa09fc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:29.472489 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6ef852fc-52cb-4c29-87af-16477baa09fc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 200 len: 1265 microversion: 2.1 time: 0.148857 Nov 08 16:18:29.473046 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 550/1108] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:29 2021] GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:30.280547 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2e17d8e4-2b7f-4827-b7c8-a8c477a547f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:18:30.287020 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2e17d8e4-2b7f-4827-b7c8-a8c477a547f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:30.287466 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2e17d8e4-2b7f-4827-b7c8-a8c477a547f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:30.347510 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2e17d8e4-2b7f-4827-b7c8-a8c477a547f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Going to try to stop instance {{(pid=115524) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 08 16:18:30.388099 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2e17d8e4-2b7f-4827-b7c8-a8c477a547f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 202 len: 0 microversion: 2.1 time: 0.111343 Nov 08 16:18:30.388775 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 559/1109] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:18:30 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:18:30.396811 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3d79a94e-f74e-46e4-bcb6-538adca2f0b3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:30.397480 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3d79a94e-f74e-46e4-bcb6-538adca2f0b3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:30.404183 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3d79a94e-f74e-46e4-bcb6-538adca2f0b3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:30.404625 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3d79a94e-f74e-46e4-bcb6-538adca2f0b3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:30.405397 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3d79a94e-f74e-46e4-bcb6-538adca2f0b3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:30.405849 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3d79a94e-f74e-46e4-bcb6-538adca2f0b3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:30.490282 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c7cee80a-4c4b-424d-8430-7d37003f9dc5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:30.491052 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c7cee80a-4c4b-424d-8430-7d37003f9dc5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:30.497615 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c7cee80a-4c4b-424d-8430-7d37003f9dc5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:30.498104 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c7cee80a-4c4b-424d-8430-7d37003f9dc5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:30.498923 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c7cee80a-4c4b-424d-8430-7d37003f9dc5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:30.499388 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c7cee80a-4c4b-424d-8430-7d37003f9dc5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:30.538585 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3d79a94e-f74e-46e4-bcb6-538adca2f0b3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:30.546651 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3d79a94e-f74e-46e4-bcb6-538adca2f0b3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1675 microversion: 2.1 time: 0.153506 Nov 08 16:18:30.547225 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 551/1110] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:30 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:30.634302 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c7cee80a-4c4b-424d-8430-7d37003f9dc5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:30.641865 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c7cee80a-4c4b-424d-8430-7d37003f9dc5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 200 len: 1265 microversion: 2.1 time: 0.155795 Nov 08 16:18:30.642417 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 560/1111] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:30 2021] GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:18:31.563568 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4ddfcae8-9115-4328-88c5-ec5519da34eb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:31.564191 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4ddfcae8-9115-4328-88c5-ec5519da34eb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:31.570371 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4ddfcae8-9115-4328-88c5-ec5519da34eb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:31.570836 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4ddfcae8-9115-4328-88c5-ec5519da34eb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:31.571591 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4ddfcae8-9115-4328-88c5-ec5519da34eb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:31.572032 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4ddfcae8-9115-4328-88c5-ec5519da34eb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:31.658751 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-399fd7b2-7c93-4ef7-a7ae-671f164bffb5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:31.659360 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-399fd7b2-7c93-4ef7-a7ae-671f164bffb5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:31.665345 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-399fd7b2-7c93-4ef7-a7ae-671f164bffb5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:31.665822 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-399fd7b2-7c93-4ef7-a7ae-671f164bffb5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:31.666597 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-399fd7b2-7c93-4ef7-a7ae-671f164bffb5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:31.667033 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-399fd7b2-7c93-4ef7-a7ae-671f164bffb5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:31.949424 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4ddfcae8-9115-4328-88c5-ec5519da34eb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:31.956570 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4ddfcae8-9115-4328-88c5-ec5519da34eb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1675 microversion: 2.1 time: 0.396679 Nov 08 16:18:31.957134 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 552/1112] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:31 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1675 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:32.011090 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-399fd7b2-7c93-4ef7-a7ae-671f164bffb5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:32.018850 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-399fd7b2-7c93-4ef7-a7ae-671f164bffb5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 200 len: 1265 microversion: 2.1 time: 0.363698 Nov 08 16:18:32.019405 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 561/1113] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:31 2021] GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 1265 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:18:32.974070 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6d09c209-252b-4d0f-bc9a-c982d0c61ce4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:32.974693 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6d09c209-252b-4d0f-bc9a-c982d0c61ce4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:32.981530 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6d09c209-252b-4d0f-bc9a-c982d0c61ce4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:32.982161 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6d09c209-252b-4d0f-bc9a-c982d0c61ce4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:32.982925 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6d09c209-252b-4d0f-bc9a-c982d0c61ce4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:32.983346 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6d09c209-252b-4d0f-bc9a-c982d0c61ce4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:33.035357 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-785b28e5-1715-43a6-834c-d03694096c66 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:33.036090 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-785b28e5-1715-43a6-834c-d03694096c66 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:33.042386 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-785b28e5-1715-43a6-834c-d03694096c66 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:33.042828 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-785b28e5-1715-43a6-834c-d03694096c66 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:33.044093 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-785b28e5-1715-43a6-834c-d03694096c66 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:33.044525 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-785b28e5-1715-43a6-834c-d03694096c66 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:33.137566 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6d09c209-252b-4d0f-bc9a-c982d0c61ce4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:33.144990 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6d09c209-252b-4d0f-bc9a-c982d0c61ce4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1675 microversion: 2.1 time: 0.174525 Nov 08 16:18:33.145562 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 553/1114] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:32 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:33.200864 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-785b28e5-1715-43a6-834c-d03694096c66 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:33.208123 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-785b28e5-1715-43a6-834c-d03694096c66 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 200 len: 1265 microversion: 2.1 time: 0.176485 Nov 08 16:18:33.208689 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 562/1115] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:33 2021] GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:18:34.162057 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4d11fb67-b22b-4b1b-956f-d9996d11155f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:34.162683 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4d11fb67-b22b-4b1b-956f-d9996d11155f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:34.169307 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4d11fb67-b22b-4b1b-956f-d9996d11155f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:34.169772 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4d11fb67-b22b-4b1b-956f-d9996d11155f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:34.170542 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4d11fb67-b22b-4b1b-956f-d9996d11155f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:34.170968 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4d11fb67-b22b-4b1b-956f-d9996d11155f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:34.224977 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-65cd49ab-f9a7-4293-8d1f-b5c67000a1e3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:34.225616 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-65cd49ab-f9a7-4293-8d1f-b5c67000a1e3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:34.232147 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-65cd49ab-f9a7-4293-8d1f-b5c67000a1e3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:34.232600 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-65cd49ab-f9a7-4293-8d1f-b5c67000a1e3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:34.233384 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-65cd49ab-f9a7-4293-8d1f-b5c67000a1e3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:34.233849 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-65cd49ab-f9a7-4293-8d1f-b5c67000a1e3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:34.331129 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4d11fb67-b22b-4b1b-956f-d9996d11155f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:34.338700 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4d11fb67-b22b-4b1b-956f-d9996d11155f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1675 microversion: 2.1 time: 0.180386 Nov 08 16:18:34.339275 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 554/1116] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:34 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:34.393488 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-65cd49ab-f9a7-4293-8d1f-b5c67000a1e3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:34.401068 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-65cd49ab-f9a7-4293-8d1f-b5c67000a1e3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 200 len: 1265 microversion: 2.1 time: 0.179776 Nov 08 16:18:34.401617 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 563/1117] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:34 2021] GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:18:35.355594 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6880858e-50c0-48f9-8e52-fb9930b4c666 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:35.356195 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6880858e-50c0-48f9-8e52-fb9930b4c666 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:35.362505 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6880858e-50c0-48f9-8e52-fb9930b4c666 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:35.362975 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6880858e-50c0-48f9-8e52-fb9930b4c666 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:35.363743 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6880858e-50c0-48f9-8e52-fb9930b4c666 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:35.364170 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6880858e-50c0-48f9-8e52-fb9930b4c666 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:35.417241 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bbdb81ad-31f7-496e-896a-1a8082a0c2ef tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:35.417886 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-bbdb81ad-31f7-496e-896a-1a8082a0c2ef tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:35.424124 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bbdb81ad-31f7-496e-896a-1a8082a0c2ef tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:35.424575 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bbdb81ad-31f7-496e-896a-1a8082a0c2ef tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:35.425347 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bbdb81ad-31f7-496e-896a-1a8082a0c2ef tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:35.425805 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bbdb81ad-31f7-496e-896a-1a8082a0c2ef tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:35.520408 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6880858e-50c0-48f9-8e52-fb9930b4c666 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:35.529052 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6880858e-50c0-48f9-8e52-fb9930b4c666 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1675 microversion: 2.1 time: 0.177089 Nov 08 16:18:35.529660 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 555/1118] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:35 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:35.584820 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-bbdb81ad-31f7-496e-896a-1a8082a0c2ef tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:35.592056 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bbdb81ad-31f7-496e-896a-1a8082a0c2ef tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 200 len: 1265 microversion: 2.1 time: 0.178450 Nov 08 16:18:35.592621 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 564/1119] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:35 2021] GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:18:36.271041 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-2f0bc988-a725-48f3-b90a-de0924523f3e req-884ddbe8-5198-46a1-a936-e8608c077259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce49cb3-8d64-40a5-9827-64fa1d2f37c2", "name": "network-vif-plugged", "status": "completed", "tag": "794847db-0663-47ab-a2b0-4bdedb698598"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:18:36.272627 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:18:36.272627 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:18:36.279722 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-2f0bc988-a725-48f3-b90a-de0924523f3e req-884ddbe8-5198-46a1-a936-e8608c077259 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:36.280315 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-2f0bc988-a725-48f3-b90a-de0924523f3e req-884ddbe8-5198-46a1-a936-e8608c077259 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:36.292765 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-2f0bc988-a725-48f3-b90a-de0924523f3e req-884ddbe8-5198-46a1-a936-e8608c077259 service nova] Creating event network-vif-plugged:794847db-0663-47ab-a2b0-4bdedb698598 for instance 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 on hv-cinder-81618 Nov 08 16:18:36.297578 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-2f0bc988-a725-48f3-b90a-de0924523f3e req-884ddbe8-5198-46a1-a936-e8608c077259 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030306 Nov 08 16:18:36.298255 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 556/1120] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:18:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:18:36.546739 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2b7aa30a-3c98-487c-a0c7-a5d9d3f552a2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:36.547363 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2b7aa30a-3c98-487c-a0c7-a5d9d3f552a2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:36.553757 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2b7aa30a-3c98-487c-a0c7-a5d9d3f552a2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:36.554196 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2b7aa30a-3c98-487c-a0c7-a5d9d3f552a2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:36.554978 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2b7aa30a-3c98-487c-a0c7-a5d9d3f552a2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:36.555418 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2b7aa30a-3c98-487c-a0c7-a5d9d3f552a2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:36.609836 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e10a0856-adeb-48fe-975c-0eadc31c40ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:36.610558 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e10a0856-adeb-48fe-975c-0eadc31c40ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:36.616649 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e10a0856-adeb-48fe-975c-0eadc31c40ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:36.617098 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e10a0856-adeb-48fe-975c-0eadc31c40ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:36.617903 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e10a0856-adeb-48fe-975c-0eadc31c40ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:36.618333 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e10a0856-adeb-48fe-975c-0eadc31c40ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:36.731159 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-2b7aa30a-3c98-487c-a0c7-a5d9d3f552a2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:36.738344 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2b7aa30a-3c98-487c-a0c7-a5d9d3f552a2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1675 microversion: 2.1 time: 0.196012 Nov 08 16:18:36.738920 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 565/1121] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:36 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1675 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:36.791037 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-e10a0856-adeb-48fe-975c-0eadc31c40ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:36.798484 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e10a0856-adeb-48fe-975c-0eadc31c40ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 200 len: 1265 microversion: 2.1 time: 0.193764 Nov 08 16:18:36.799046 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 557/1122] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:36 2021] GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:18:37.754955 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-54c01f14-6d8c-49c8-8001-39c8b25f2d49 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:37.755506 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-54c01f14-6d8c-49c8-8001-39c8b25f2d49 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:37.761727 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-54c01f14-6d8c-49c8-8001-39c8b25f2d49 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:37.762194 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-54c01f14-6d8c-49c8-8001-39c8b25f2d49 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:37.762959 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-54c01f14-6d8c-49c8-8001-39c8b25f2d49 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:37.763408 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-54c01f14-6d8c-49c8-8001-39c8b25f2d49 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:37.815057 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0db976ac-1925-4c4d-844f-b3d1c7b91686 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:37.815658 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0db976ac-1925-4c4d-844f-b3d1c7b91686 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:37.822002 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0db976ac-1925-4c4d-844f-b3d1c7b91686 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:37.822451 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0db976ac-1925-4c4d-844f-b3d1c7b91686 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:37.823221 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0db976ac-1925-4c4d-844f-b3d1c7b91686 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:37.823656 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0db976ac-1925-4c4d-844f-b3d1c7b91686 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:37.927574 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-54c01f14-6d8c-49c8-8001-39c8b25f2d49 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:37.934947 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-54c01f14-6d8c-49c8-8001-39c8b25f2d49 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1675 microversion: 2.1 time: 0.183866 Nov 08 16:18:37.935508 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 566/1123] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:37 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:37.983261 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0db976ac-1925-4c4d-844f-b3d1c7b91686 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:37.990551 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0db976ac-1925-4c4d-844f-b3d1c7b91686 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 200 len: 1265 microversion: 2.1 time: 0.179115 Nov 08 16:18:37.991114 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 558/1124] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:37 2021] GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:18:38.951169 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9ec546dc-4393-40de-ba58-b369fe665a92 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:38.951775 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9ec546dc-4393-40de-ba58-b369fe665a92 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:38.958006 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ec546dc-4393-40de-ba58-b369fe665a92 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:38.958452 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ec546dc-4393-40de-ba58-b369fe665a92 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:38.959275 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ec546dc-4393-40de-ba58-b369fe665a92 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:38.959706 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9ec546dc-4393-40de-ba58-b369fe665a92 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:39.007256 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ea26e76d-a30d-4ea0-be64-b79f81801c16 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:39.007840 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ea26e76d-a30d-4ea0-be64-b79f81801c16 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:39.014470 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ea26e76d-a30d-4ea0-be64-b79f81801c16 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:39.015010 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ea26e76d-a30d-4ea0-be64-b79f81801c16 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:39.015902 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ea26e76d-a30d-4ea0-be64-b79f81801c16 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:39.016545 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ea26e76d-a30d-4ea0-be64-b79f81801c16 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:39.123221 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-9ec546dc-4393-40de-ba58-b369fe665a92 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:39.130540 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9ec546dc-4393-40de-ba58-b369fe665a92 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1675 microversion: 2.1 time: 0.183570 Nov 08 16:18:39.131104 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 567/1125] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:38 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:39.180164 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ea26e76d-a30d-4ea0-be64-b79f81801c16 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:39.187910 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ea26e76d-a30d-4ea0-be64-b79f81801c16 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 200 len: 1452 microversion: 2.1 time: 0.184327 Nov 08 16:18:39.188476 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 559/1126] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:39 2021] GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 1452 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:18:39.203506 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-27291c19-a222-4a12-9e4b-14151592f157 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:39.204037 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-27291c19-a222-4a12-9e4b-14151592f157 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:39.209840 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-27291c19-a222-4a12-9e4b-14151592f157 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:39.210286 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-27291c19-a222-4a12-9e4b-14151592f157 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:39.211044 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-27291c19-a222-4a12-9e4b-14151592f157 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:39.211473 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-27291c19-a222-4a12-9e4b-14151592f157 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:39.341222 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-27291c19-a222-4a12-9e4b-14151592f157 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:39.348466 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-27291c19-a222-4a12-9e4b-14151592f157 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 200 len: 1452 microversion: 2.1 time: 0.148625 Nov 08 16:18:39.349030 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 568/1127] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:39 2021] GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:40.147483 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-7e4f36b3-69ff-499b-b55a-850d2a045b51 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:40.148114 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-7e4f36b3-69ff-499b-b55a-850d2a045b51 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:40.154356 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7e4f36b3-69ff-499b-b55a-850d2a045b51 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:40.154802 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7e4f36b3-69ff-499b-b55a-850d2a045b51 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:40.155580 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7e4f36b3-69ff-499b-b55a-850d2a045b51 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:40.156006 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7e4f36b3-69ff-499b-b55a-850d2a045b51 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:40.386318 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7e4f36b3-69ff-499b-b55a-850d2a045b51 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:40.393633 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-7e4f36b3-69ff-499b-b55a-850d2a045b51 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1675 microversion: 2.1 time: 0.249806 Nov 08 16:18:40.394226 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 560/1128] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:40 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1675 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:40.986004 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-3f0eab59-2f41-4585-8191-6ba84edec0db req-9499499f-828c-49fd-bc3d-9bc318797ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ce49cb3-8d64-40a5-9827-64fa1d2f37c2", "tag": "794847db-0663-47ab-a2b0-4bdedb698598"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:18:40.988325 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:18:40.988325 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:18:40.996483 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-3f0eab59-2f41-4585-8191-6ba84edec0db req-9499499f-828c-49fd-bc3d-9bc318797ac0 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:40.997059 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-3f0eab59-2f41-4585-8191-6ba84edec0db req-9499499f-828c-49fd-bc3d-9bc318797ac0 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:41.007905 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-3f0eab59-2f41-4585-8191-6ba84edec0db req-9499499f-828c-49fd-bc3d-9bc318797ac0 service nova] Creating event network-changed:794847db-0663-47ab-a2b0-4bdedb698598 for instance 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 on hv-cinder-81618 Nov 08 16:18:41.012892 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-3f0eab59-2f41-4585-8191-6ba84edec0db req-9499499f-828c-49fd-bc3d-9bc318797ac0 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030525 Nov 08 16:18:41.013541 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 569/1129] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:18:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:18:41.410736 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b63a27d7-83de-4021-994a-e5924586c1dc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:41.411324 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b63a27d7-83de-4021-994a-e5924586c1dc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:41.417887 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b63a27d7-83de-4021-994a-e5924586c1dc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:41.418331 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b63a27d7-83de-4021-994a-e5924586c1dc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:41.419347 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b63a27d7-83de-4021-994a-e5924586c1dc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:41.419767 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b63a27d7-83de-4021-994a-e5924586c1dc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:41.628192 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b63a27d7-83de-4021-994a-e5924586c1dc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:41.635494 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b63a27d7-83de-4021-994a-e5924586c1dc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1675 microversion: 2.1 time: 0.228478 Nov 08 16:18:41.636065 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 561/1130] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:41 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1675 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:42.653757 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2e1287ac-b94e-4a6b-b12c-124defd26ad6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:42.654487 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2e1287ac-b94e-4a6b-b12c-124defd26ad6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:42.660526 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2e1287ac-b94e-4a6b-b12c-124defd26ad6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:42.660981 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2e1287ac-b94e-4a6b-b12c-124defd26ad6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:42.661781 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2e1287ac-b94e-4a6b-b12c-124defd26ad6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:42.662237 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2e1287ac-b94e-4a6b-b12c-124defd26ad6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:42.793336 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-2e1287ac-b94e-4a6b-b12c-124defd26ad6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:42.800581 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2e1287ac-b94e-4a6b-b12c-124defd26ad6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1675 microversion: 2.1 time: 0.151907 Nov 08 16:18:42.801147 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 570/1131] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:42 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:43.817249 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f59c26fd-94b4-48ec-96d5-1800f2b3ae51 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:43.817879 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f59c26fd-94b4-48ec-96d5-1800f2b3ae51 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:43.824068 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f59c26fd-94b4-48ec-96d5-1800f2b3ae51 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:43.824504 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f59c26fd-94b4-48ec-96d5-1800f2b3ae51 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:43.825260 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f59c26fd-94b4-48ec-96d5-1800f2b3ae51 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:43.825682 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f59c26fd-94b4-48ec-96d5-1800f2b3ae51 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:43.952625 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f59c26fd-94b4-48ec-96d5-1800f2b3ae51 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:43.960061 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f59c26fd-94b4-48ec-96d5-1800f2b3ae51 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1675 microversion: 2.1 time: 0.147048 Nov 08 16:18:43.960640 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 562/1132] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:43 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:44.977837 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-cb4bcf7d-a116-4853-bea5-d8e7aa37f030 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:44.978475 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-cb4bcf7d-a116-4853-bea5-d8e7aa37f030 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:44.984776 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cb4bcf7d-a116-4853-bea5-d8e7aa37f030 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:44.985228 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cb4bcf7d-a116-4853-bea5-d8e7aa37f030 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:44.986032 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cb4bcf7d-a116-4853-bea5-d8e7aa37f030 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:44.986470 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cb4bcf7d-a116-4853-bea5-d8e7aa37f030 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:45.123003 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-cb4bcf7d-a116-4853-bea5-d8e7aa37f030 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:45.130325 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-cb4bcf7d-a116-4853-bea5-d8e7aa37f030 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1675 microversion: 2.1 time: 0.156221 Nov 08 16:18:45.130882 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 571/1133] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:44 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:46.147563 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-abc645dc-5ec7-4726-933a-77d8996cf248 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:46.148170 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-abc645dc-5ec7-4726-933a-77d8996cf248 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:46.155030 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-abc645dc-5ec7-4726-933a-77d8996cf248 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:46.155476 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-abc645dc-5ec7-4726-933a-77d8996cf248 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:46.156240 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-abc645dc-5ec7-4726-933a-77d8996cf248 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:46.156671 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-abc645dc-5ec7-4726-933a-77d8996cf248 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:46.285237 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-abc645dc-5ec7-4726-933a-77d8996cf248 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:46.292531 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-abc645dc-5ec7-4726-933a-77d8996cf248 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1652 microversion: 2.1 time: 0.148656 Nov 08 16:18:46.293687 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 563/1134] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:46 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1652 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:46.308951 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3c5218ff-5407-49a9-9e83-80b9596195cd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:18:46.315245 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3c5218ff-5407-49a9-9e83-80b9596195cd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:46.315679 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3c5218ff-5407-49a9-9e83-80b9596195cd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:46.336614 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3c5218ff-5407-49a9-9e83-80b9596195cd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Going to try to start instance {{(pid=115524) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 08 16:18:46.376281 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3c5218ff-5407-49a9-9e83-80b9596195cd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action" status: 202 len: 0 microversion: 2.1 time: 0.070885 Nov 08 16:18:46.376889 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 572/1135] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:18:46 2021] POST /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/action => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:18:46.384612 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-025cd2fb-3681-41bf-8478-9815c139b3a7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:46.385238 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-025cd2fb-3681-41bf-8478-9815c139b3a7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:46.391608 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-025cd2fb-3681-41bf-8478-9815c139b3a7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:46.392111 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-025cd2fb-3681-41bf-8478-9815c139b3a7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:46.392845 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-025cd2fb-3681-41bf-8478-9815c139b3a7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:46.393269 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-025cd2fb-3681-41bf-8478-9815c139b3a7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:46.557833 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-025cd2fb-3681-41bf-8478-9815c139b3a7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:46.565142 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-025cd2fb-3681-41bf-8478-9815c139b3a7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1661 microversion: 2.1 time: 0.184158 Nov 08 16:18:46.565725 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 564/1136] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:46 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1661 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:18:47.585044 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-dbd6559d-b469-4936-943d-a22be743a42c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:18:47.586032 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-dbd6559d-b469-4936-943d-a22be743a42c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:18:47.592215 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dbd6559d-b469-4936-943d-a22be743a42c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:47.592656 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dbd6559d-b469-4936-943d-a22be743a42c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:47.593461 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dbd6559d-b469-4936-943d-a22be743a42c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:18:47.594123 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dbd6559d-b469-4936-943d-a22be743a42c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:18:47.730090 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-dbd6559d-b469-4936-943d-a22be743a42c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:18:47.737288 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-dbd6559d-b469-4936-943d-a22be743a42c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1665 microversion: 2.1 time: 0.158125 Nov 08 16:18:47.737925 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 573/1137] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:18:47 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:19:20.737167 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e2a29dcd-bdf9-4a51-ab74-0057e5c54948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:20.737871 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e2a29dcd-bdf9-4a51-ab74-0057e5c54948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:20.743979 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e2a29dcd-bdf9-4a51-ab74-0057e5c54948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:20.744420 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e2a29dcd-bdf9-4a51-ab74-0057e5c54948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:20.745184 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e2a29dcd-bdf9-4a51-ab74-0057e5c54948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:20.745609 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e2a29dcd-bdf9-4a51-ab74-0057e5c54948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:20.773015 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e2a29dcd-bdf9-4a51-ab74-0057e5c54948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/os-volume_attachments/8a08ec66-fd01-4f89-88ce-00290b3f851a" status: 200 len: 194 microversion: 2.20 time: 0.039665 Nov 08 16:19:20.773577 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 565/1138] 10.222.0.37 () {60 vars in 1453 bytes} [Mon Nov 8 16:19:20 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/os-volume_attachments/8a08ec66-fd01-4f89-88ce-00290b3f851a => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:19:20.831010 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7fda5a7a-2785-4353-962b-f3c890ee064c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:20.831505 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7fda5a7a-2785-4353-962b-f3c890ee064c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:20.837461 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7fda5a7a-2785-4353-962b-f3c890ee064c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:20.838439 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7fda5a7a-2785-4353-962b-f3c890ee064c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:20.839218 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7fda5a7a-2785-4353-962b-f3c890ee064c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:20.839651 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7fda5a7a-2785-4353-962b-f3c890ee064c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:20.914760 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.objects.instance [None req-7fda5a7a-2785-4353-962b-f3c890ee064c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lazy-loading 'services' on Instance uuid 1c1c8c8d-5f78-45fb-803d-8f7a84df3433 {{(pid=115524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:19:20.981302 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7fda5a7a-2785-4353-962b-f3c890ee064c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "DELETE /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/os-volume_attachments/8a08ec66-fd01-4f89-88ce-00290b3f851a" status: 202 len: 0 microversion: 2.20 time: 0.153892 Nov 08 16:19:20.981914 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 574/1139] 10.222.0.37 () {60 vars in 1456 bytes} [Mon Nov 8 16:19:20 2021] DELETE /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/os-volume_attachments/8a08ec66-fd01-4f89-88ce-00290b3f851a => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:19:20.990368 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b4b6ff35-a20c-4a1d-8c1f-9c78d85fac53 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:20.991204 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b4b6ff35-a20c-4a1d-8c1f-9c78d85fac53 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:20.997819 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b4b6ff35-a20c-4a1d-8c1f-9c78d85fac53 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:20.998330 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b4b6ff35-a20c-4a1d-8c1f-9c78d85fac53 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:20.999139 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b4b6ff35-a20c-4a1d-8c1f-9c78d85fac53 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:20.999583 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b4b6ff35-a20c-4a1d-8c1f-9c78d85fac53 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:21.031441 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b4b6ff35-a20c-4a1d-8c1f-9c78d85fac53 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045039 Nov 08 16:19:21.031961 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 566/1140] 10.222.0.37 () {60 vars in 1342 bytes} [Mon Nov 8 16:19:20 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:19:22.044384 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-febf5098-56d0-4eb5-9000-863eb854c2a7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:22.045313 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-febf5098-56d0-4eb5-9000-863eb854c2a7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:22.051374 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-febf5098-56d0-4eb5-9000-863eb854c2a7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:22.051824 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-febf5098-56d0-4eb5-9000-863eb854c2a7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:22.052585 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-febf5098-56d0-4eb5-9000-863eb854c2a7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:22.053023 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-febf5098-56d0-4eb5-9000-863eb854c2a7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:22.081702 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-febf5098-56d0-4eb5-9000-863eb854c2a7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042133 Nov 08 16:19:22.082362 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 575/1141] 10.222.0.37 () {60 vars in 1342 bytes} [Mon Nov 8 16:19:22 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:19:22.138382 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c7373d68-7da9-4115-8ed6-f47ed45f9948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:22.138949 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c7373d68-7da9-4115-8ed6-f47ed45f9948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:22.145406 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c7373d68-7da9-4115-8ed6-f47ed45f9948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:22.145885 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c7373d68-7da9-4115-8ed6-f47ed45f9948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:22.146646 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c7373d68-7da9-4115-8ed6-f47ed45f9948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:22.147067 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c7373d68-7da9-4115-8ed6-f47ed45f9948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:22.170853 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c7373d68-7da9-4115-8ed6-f47ed45f9948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Going to try to terminate instance {{(pid=115523) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:19:22.242137 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c7373d68-7da9-4115-8ed6-f47ed45f9948 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "DELETE /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 204 len: 0 microversion: 2.20 time: 0.108243 Nov 08 16:19:22.242701 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 567/1142] 10.222.0.37 () {60 vars in 1279 bytes} [Mon Nov 8 16:19:22 2021] DELETE /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 08 16:19:22.251568 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-adf4fa93-ac6b-4f45-bc90-f7fac96416aa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:22.252169 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-adf4fa93-ac6b-4f45-bc90-f7fac96416aa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:22.257901 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-adf4fa93-ac6b-4f45-bc90-f7fac96416aa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:22.258351 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-adf4fa93-ac6b-4f45-bc90-f7fac96416aa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:22.259118 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-adf4fa93-ac6b-4f45-bc90-f7fac96416aa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:22.259553 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-adf4fa93-ac6b-4f45-bc90-f7fac96416aa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:22.385652 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-adf4fa93-ac6b-4f45-bc90-f7fac96416aa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:22.393226 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-adf4fa93-ac6b-4f45-bc90-f7fac96416aa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:22.394738 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-adf4fa93-ac6b-4f45-bc90-f7fac96416aa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:22.395878 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-adf4fa93-ac6b-4f45-bc90-f7fac96416aa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.147975 Nov 08 16:19:22.396428 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 576/1143] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:19:22 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:19:23.414461 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b6a520a1-868a-45bd-97c8-3ea17e22bc29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:23.415074 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b6a520a1-868a-45bd-97c8-3ea17e22bc29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:23.421289 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b6a520a1-868a-45bd-97c8-3ea17e22bc29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:23.421751 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b6a520a1-868a-45bd-97c8-3ea17e22bc29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:23.422509 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b6a520a1-868a-45bd-97c8-3ea17e22bc29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:23.422934 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b6a520a1-868a-45bd-97c8-3ea17e22bc29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:23.548105 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b6a520a1-868a-45bd-97c8-3ea17e22bc29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:23.555759 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b6a520a1-868a-45bd-97c8-3ea17e22bc29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:23.557774 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b6a520a1-868a-45bd-97c8-3ea17e22bc29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:23.558922 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b6a520a1-868a-45bd-97c8-3ea17e22bc29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.148606 Nov 08 16:19:23.559475 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 568/1144] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:19:23 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:19:24.576962 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-cd712ad7-43b9-464a-9adf-be411bfef768 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:24.577562 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-cd712ad7-43b9-464a-9adf-be411bfef768 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:24.584229 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cd712ad7-43b9-464a-9adf-be411bfef768 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:24.584655 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cd712ad7-43b9-464a-9adf-be411bfef768 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:24.585433 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cd712ad7-43b9-464a-9adf-be411bfef768 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:24.585891 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cd712ad7-43b9-464a-9adf-be411bfef768 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:24.888854 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-cd712ad7-43b9-464a-9adf-be411bfef768 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:24.896836 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-cd712ad7-43b9-464a-9adf-be411bfef768 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:24.898364 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-cd712ad7-43b9-464a-9adf-be411bfef768 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:24.899521 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-cd712ad7-43b9-464a-9adf-be411bfef768 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 200 len: 1725 microversion: 2.20 time: 0.326317 Nov 08 16:19:24.900077 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 577/1145] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:19:24 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 1725 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:19:25.382441 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-5e81ff8a-84a3-4fb2-a283-8bc0b28f556c req-dd7ee787-f215-41c9-b3cd-79f1365c5fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "name": "network-vif-deleted", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:25.385294 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:19:25.385294 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:19:25.395639 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-5e81ff8a-84a3-4fb2-a283-8bc0b28f556c req-dd7ee787-f215-41c9-b3cd-79f1365c5fed service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:25.396313 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-5e81ff8a-84a3-4fb2-a283-8bc0b28f556c req-dd7ee787-f215-41c9-b3cd-79f1365c5fed service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:25.411065 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-5e81ff8a-84a3-4fb2-a283-8bc0b28f556c req-dd7ee787-f215-41c9-b3cd-79f1365c5fed service nova] Creating event network-vif-deleted:fbefda08-fc7a-42a0-b714-6dea3d8a5161 for instance 1c1c8c8d-5f78-45fb-803d-8f7a84df3433 on hv-cinder-81618 Nov 08 16:19:25.416168 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-5e81ff8a-84a3-4fb2-a283-8bc0b28f556c req-dd7ee787-f215-41c9-b3cd-79f1365c5fed service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038269 Nov 08 16:19:25.416837 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 569/1146] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:19:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:19:25.918304 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-34c2e005-0492-46fb-8792-a96f93c385b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:25.918866 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-34c2e005-0492-46fb-8792-a96f93c385b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:25.925324 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-34c2e005-0492-46fb-8792-a96f93c385b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:25.925797 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-34c2e005-0492-46fb-8792-a96f93c385b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:25.926584 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-34c2e005-0492-46fb-8792-a96f93c385b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:25.927014 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-34c2e005-0492-46fb-8792-a96f93c385b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:25.942725 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-34c2e005-0492-46fb-8792-a96f93c385b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] HTTP exception thrown: Instance 1c1c8c8d-5f78-45fb-803d-8f7a84df3433 could not be found. Nov 08 16:19:25.943318 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-34c2e005-0492-46fb-8792-a96f93c385b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Returning 404 to user: Instance 1c1c8c8d-5f78-45fb-803d-8f7a84df3433 could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:19:25.944143 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-34c2e005-0492-46fb-8792-a96f93c385b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 404 len: 111 microversion: 2.20 time: 0.029759 Nov 08 16:19:25.944915 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 578/1147] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:19:25 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 08 16:19:25.953731 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-17375bc5-5b52-4065-adf6-96b0e39c3b8d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '.version_select at 0x7f8c107993a0>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:25.976501 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-17375bc5-5b52-4065-adf6-96b0e39c3b8d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1427302328" status: 204 len: 0 microversion: 2.20 time: 0.026924 Nov 08 16:19:25.977073 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 570/1148] 10.222.0.37 () {60 vars in 1261 bytes} [Mon Nov 8 16:19:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1427302328 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 08 16:19:26.696311 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3812d7f7-17da-4002-884e-c6db01541bfa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'create', calling method: .version_select at 0x7f8c072ff280>, body: {"keypair": {"name": "tempest-keypair-887846981"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:26.709927 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-3812d7f7-17da-4002-884e-c6db01541bfa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Getting quotas for project 10a4252a63bf480d93d2e9da15bb8efd. Resources: {'key_pairs'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:19:26.714227 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-3812d7f7-17da-4002-884e-c6db01541bfa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Getting quotas for user 5f2f258a03f24a94a7da462be24b1d3b and project 10a4252a63bf480d93d2e9da15bb8efd. Resources: {'key_pairs'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:19:26.840904 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-3812d7f7-17da-4002-884e-c6db01541bfa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Getting quotas for project 10a4252a63bf480d93d2e9da15bb8efd. Resources: {'key_pairs'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:19:26.844509 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-3812d7f7-17da-4002-884e-c6db01541bfa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Getting quotas for user 5f2f258a03f24a94a7da462be24b1d3b and project 10a4252a63bf480d93d2e9da15bb8efd. Resources: {'key_pairs'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:19:26.857671 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3812d7f7-17da-4002-884e-c6db01541bfa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.165292 Nov 08 16:19:26.858283 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 579/1149] 10.222.0.37 () {62 vars in 1198 bytes} [Mon Nov 8 16:19:26 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 167 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Nov 08 16:19:28.091243 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8d9958ba-3372-4c04-8976-78d9166b9f29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1358166375", "imageRef": "9abeafba-e602-4e0a-aab2-62160562de06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0e08679-82fe-47eb-90b6-49a1713fdaca"}], "security_groups": [{"name": "tempest-securitygroup--602507164"}], "key_name": "tempest-keypair-887846981", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:28.192558 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.network.neutron [None req-8d9958ba-3372-4c04-8976-78d9166b9f29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] validate_networks() for [('e0e08679-82fe-47eb-90b6-49a1713fdaca', None, None, None, None, None)] {{(pid=115523) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:19:28.549983 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-8d9958ba-3372-4c04-8976-78d9166b9f29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Flavor limits 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:19:28.550408 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-8d9958ba-3372-4c04-8976-78d9166b9f29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Image limits 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:19:28.550879 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-8d9958ba-3372-4c04-8976-78d9166b9f29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Flavor pref 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:19:28.551285 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-8d9958ba-3372-4c04-8976-78d9166b9f29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Image pref 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:19:28.551694 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-8d9958ba-3372-4c04-8976-78d9166b9f29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:19:28.560057 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8d9958ba-3372-4c04-8976-78d9166b9f29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:28.560496 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8d9958ba-3372-4c04-8976-78d9166b9f29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:28.561297 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8d9958ba-3372-4c04-8976-78d9166b9f29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:28.561752 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8d9958ba-3372-4c04-8976-78d9166b9f29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:28.577852 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-8d9958ba-3372-4c04-8976-78d9166b9f29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Getting quotas for project 10a4252a63bf480d93d2e9da15bb8efd. Resources: {'instances', 'ram', 'cores'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:19:28.581681 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-8d9958ba-3372-4c04-8976-78d9166b9f29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Getting quotas for user 5f2f258a03f24a94a7da462be24b1d3b and project 10a4252a63bf480d93d2e9da15bb8efd. Resources: {'instances', 'ram', 'cores'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:19:28.592757 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8d9958ba-3372-4c04-8976-78d9166b9f29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Going to run 1 instances... {{(pid=115523) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:19:28.595152 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8d9958ba-3372-4c04-8976-78d9166b9f29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9abeafba-e602-4e0a-aab2-62160562de06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:19:28.639948 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8d9958ba-3372-4c04-8976-78d9166b9f29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.553831 Nov 08 16:19:28.640593 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 571/1150] 10.222.0.37 () {62 vars in 1187 bytes} [Mon Nov 8 16:19:28 2021] POST /compute/v2.1/servers => generated 401 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 08 16:19:28.651239 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-95993870-9821-41e8-b075-d738befac8bc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:28.651845 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-95993870-9821-41e8-b075-d738befac8bc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:28.702523 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-95993870-9821-41e8-b075-d738befac8bc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:28.710459 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-95993870-9821-41e8-b075-d738befac8bc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:28.711954 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-95993870-9821-41e8-b075-d738befac8bc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:28.713625 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-95993870-9821-41e8-b075-d738befac8bc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1281 microversion: 2.20 time: 0.066525 Nov 08 16:19:28.714209 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 580/1151] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:19:28 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1281 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:19:29.732477 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-88671e54-b4cf-4c41-ab4e-d6ba0a468a44 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:29.733102 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-88671e54-b4cf-4c41-ab4e-d6ba0a468a44 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:29.739781 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-88671e54-b4cf-4c41-ab4e-d6ba0a468a44 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:29.740224 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-88671e54-b4cf-4c41-ab4e-d6ba0a468a44 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:29.740995 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-88671e54-b4cf-4c41-ab4e-d6ba0a468a44 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:29.741420 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-88671e54-b4cf-4c41-ab4e-d6ba0a468a44 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:29.803409 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-88671e54-b4cf-4c41-ab4e-d6ba0a468a44 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:29.811119 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-88671e54-b4cf-4c41-ab4e-d6ba0a468a44 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:29.812612 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-88671e54-b4cf-4c41-ab4e-d6ba0a468a44 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:29.813735 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-88671e54-b4cf-4c41-ab4e-d6ba0a468a44 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1339 microversion: 2.20 time: 0.086110 Nov 08 16:19:29.814283 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 572/1152] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:19:29 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1339 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:19:30.823746 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-7fcd85f9-ac09-4d62-9ae1-9b474952cb45 req-a02f34ac-2af8-4805-991c-eb396f736bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:30.827261 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:19:30.827261 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:19:30.834909 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8a1b8c5c-c417-4b54-ba43-5b135d4c33c4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:30.835570 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8a1b8c5c-c417-4b54-ba43-5b135d4c33c4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:30.836941 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-7fcd85f9-ac09-4d62-9ae1-9b474952cb45 req-a02f34ac-2af8-4805-991c-eb396f736bd7 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:30.838001 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-7fcd85f9-ac09-4d62-9ae1-9b474952cb45 req-a02f34ac-2af8-4805-991c-eb396f736bd7 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:30.854544 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-7fcd85f9-ac09-4d62-9ae1-9b474952cb45 req-a02f34ac-2af8-4805-991c-eb396f736bd7 service nova] Creating event network-changed:b3094cea-72ef-41cf-ac88-a6d678f0fb09 for instance f0c4ded0-3419-458b-ab12-da310a2b2fd7 on hv-cinder-81618 Nov 08 16:19:30.857926 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8a1b8c5c-c417-4b54-ba43-5b135d4c33c4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:30.858433 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8a1b8c5c-c417-4b54-ba43-5b135d4c33c4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:30.860002 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8a1b8c5c-c417-4b54-ba43-5b135d4c33c4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:30.860322 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8a1b8c5c-c417-4b54-ba43-5b135d4c33c4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:30.861105 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-7fcd85f9-ac09-4d62-9ae1-9b474952cb45 req-a02f34ac-2af8-4805-991c-eb396f736bd7 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040440 Nov 08 16:19:30.862509 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 581/1153] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:19:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:19:31.066655 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8a1b8c5c-c417-4b54-ba43-5b135d4c33c4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:31.074640 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8a1b8c5c-c417-4b54-ba43-5b135d4c33c4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:31.076160 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8a1b8c5c-c417-4b54-ba43-5b135d4c33c4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:31.077479 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8a1b8c5c-c417-4b54-ba43-5b135d4c33c4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1406 microversion: 2.20 time: 0.249272 Nov 08 16:19:31.078134 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 573/1154] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:19:30 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:19:32.096826 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bfd1d0be-efae-450c-a14b-a540022d58e6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:32.097509 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-bfd1d0be-efae-450c-a14b-a540022d58e6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:32.104092 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bfd1d0be-efae-450c-a14b-a540022d58e6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:32.104531 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bfd1d0be-efae-450c-a14b-a540022d58e6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:32.105293 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bfd1d0be-efae-450c-a14b-a540022d58e6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:32.105733 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bfd1d0be-efae-450c-a14b-a540022d58e6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:32.236941 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-bfd1d0be-efae-450c-a14b-a540022d58e6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:32.245424 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-bfd1d0be-efae-450c-a14b-a540022d58e6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:32.246964 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-bfd1d0be-efae-450c-a14b-a540022d58e6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:32.248057 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bfd1d0be-efae-450c-a14b-a540022d58e6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1406 microversion: 2.20 time: 0.155937 Nov 08 16:19:32.248613 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 582/1155] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:19:32 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:19:33.265768 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-961ef5a0-b4c1-466d-b225-55d052552d91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:33.266371 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-961ef5a0-b4c1-466d-b225-55d052552d91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:33.272553 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-961ef5a0-b4c1-466d-b225-55d052552d91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:33.273004 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-961ef5a0-b4c1-466d-b225-55d052552d91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:33.273821 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-961ef5a0-b4c1-466d-b225-55d052552d91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:33.274239 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-961ef5a0-b4c1-466d-b225-55d052552d91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:33.399459 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-961ef5a0-b4c1-466d-b225-55d052552d91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:33.407558 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-961ef5a0-b4c1-466d-b225-55d052552d91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:33.409061 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-961ef5a0-b4c1-466d-b225-55d052552d91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:33.410194 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-961ef5a0-b4c1-466d-b225-55d052552d91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1406 microversion: 2.20 time: 0.148210 Nov 08 16:19:33.410751 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 574/1156] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:19:33 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:19:34.428014 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-883f8f0a-7423-46b7-8f6e-4cd5fbee92b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:34.428619 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-883f8f0a-7423-46b7-8f6e-4cd5fbee92b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:34.434783 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-883f8f0a-7423-46b7-8f6e-4cd5fbee92b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:34.435233 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-883f8f0a-7423-46b7-8f6e-4cd5fbee92b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:34.436005 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-883f8f0a-7423-46b7-8f6e-4cd5fbee92b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:34.436439 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-883f8f0a-7423-46b7-8f6e-4cd5fbee92b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:34.567370 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-883f8f0a-7423-46b7-8f6e-4cd5fbee92b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:34.575754 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-883f8f0a-7423-46b7-8f6e-4cd5fbee92b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:34.577253 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-883f8f0a-7423-46b7-8f6e-4cd5fbee92b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:34.578430 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-883f8f0a-7423-46b7-8f6e-4cd5fbee92b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1406 microversion: 2.20 time: 0.154224 Nov 08 16:19:34.578977 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 583/1157] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:19:34 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:19:35.596126 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d830a9e0-8d8e-47f9-9420-6973474f0d0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:35.596724 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d830a9e0-8d8e-47f9-9420-6973474f0d0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:35.603512 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d830a9e0-8d8e-47f9-9420-6973474f0d0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:35.603951 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d830a9e0-8d8e-47f9-9420-6973474f0d0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:35.604708 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d830a9e0-8d8e-47f9-9420-6973474f0d0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:35.605130 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d830a9e0-8d8e-47f9-9420-6973474f0d0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:35.732552 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d830a9e0-8d8e-47f9-9420-6973474f0d0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:35.740526 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d830a9e0-8d8e-47f9-9420-6973474f0d0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:35.742036 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d830a9e0-8d8e-47f9-9420-6973474f0d0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:35.743109 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d830a9e0-8d8e-47f9-9420-6973474f0d0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1406 microversion: 2.20 time: 0.150681 Nov 08 16:19:35.743912 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 575/1158] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:19:35 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:19:36.523078 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-d073fd35-be75-41cb-84c5-ec79f5f2d5e8 req-c60f07a3-0152-4256-871a-823df755dbde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "name": "network-vif-plugged", "status": "completed", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:36.524574 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:19:36.524574 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:19:36.532052 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-d073fd35-be75-41cb-84c5-ec79f5f2d5e8 req-c60f07a3-0152-4256-871a-823df755dbde service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:36.532493 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-d073fd35-be75-41cb-84c5-ec79f5f2d5e8 req-c60f07a3-0152-4256-871a-823df755dbde service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:36.543081 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-d073fd35-be75-41cb-84c5-ec79f5f2d5e8 req-c60f07a3-0152-4256-871a-823df755dbde service nova] Creating event network-vif-plugged:b3094cea-72ef-41cf-ac88-a6d678f0fb09 for instance f0c4ded0-3419-458b-ab12-da310a2b2fd7 on hv-cinder-81618 Nov 08 16:19:36.548253 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-d073fd35-be75-41cb-84c5-ec79f5f2d5e8 req-c60f07a3-0152-4256-871a-823df755dbde service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028873 Nov 08 16:19:36.548832 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 584/1159] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:19:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:19:36.761343 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-53b453b4-e7ec-456f-8b52-3670445d229a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:36.761969 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-53b453b4-e7ec-456f-8b52-3670445d229a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:36.768043 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-53b453b4-e7ec-456f-8b52-3670445d229a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:36.768477 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-53b453b4-e7ec-456f-8b52-3670445d229a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:36.769228 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-53b453b4-e7ec-456f-8b52-3670445d229a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:36.769672 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-53b453b4-e7ec-456f-8b52-3670445d229a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:36.897925 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-53b453b4-e7ec-456f-8b52-3670445d229a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:36.906066 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-53b453b4-e7ec-456f-8b52-3670445d229a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:36.907550 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-53b453b4-e7ec-456f-8b52-3670445d229a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:36.908637 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-53b453b4-e7ec-456f-8b52-3670445d229a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1406 microversion: 2.20 time: 0.151757 Nov 08 16:19:36.909187 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 576/1160] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:19:36 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:19:37.927278 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b25e9a96-96df-43cc-a260-d2729275ade4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:37.927884 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b25e9a96-96df-43cc-a260-d2729275ade4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:37.933963 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b25e9a96-96df-43cc-a260-d2729275ade4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:37.934411 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b25e9a96-96df-43cc-a260-d2729275ade4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:37.935173 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b25e9a96-96df-43cc-a260-d2729275ade4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:37.935600 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b25e9a96-96df-43cc-a260-d2729275ade4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:38.061613 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b25e9a96-96df-43cc-a260-d2729275ade4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:38.069209 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b25e9a96-96df-43cc-a260-d2729275ade4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:38.070713 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-b25e9a96-96df-43cc-a260-d2729275ade4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:38.071793 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b25e9a96-96df-43cc-a260-d2729275ade4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1406 microversion: 2.20 time: 0.149194 Nov 08 16:19:38.072346 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 585/1161] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:19:37 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:19:39.090009 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ea0b64ea-6c79-436c-87b0-2cb44340a1bf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:39.090601 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ea0b64ea-6c79-436c-87b0-2cb44340a1bf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:39.096854 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ea0b64ea-6c79-436c-87b0-2cb44340a1bf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:39.097291 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ea0b64ea-6c79-436c-87b0-2cb44340a1bf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:39.098100 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ea0b64ea-6c79-436c-87b0-2cb44340a1bf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:39.098519 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ea0b64ea-6c79-436c-87b0-2cb44340a1bf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:39.226576 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ea0b64ea-6c79-436c-87b0-2cb44340a1bf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:39.234608 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ea0b64ea-6c79-436c-87b0-2cb44340a1bf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:39.236080 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ea0b64ea-6c79-436c-87b0-2cb44340a1bf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:39.237236 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ea0b64ea-6c79-436c-87b0-2cb44340a1bf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1599 microversion: 2.20 time: 0.151526 Nov 08 16:19:39.237803 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 577/1162] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:19:39 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:19:39.254909 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-dfa77877-7607-4aac-8b98-6dfc5828b46b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:39.255396 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-dfa77877-7607-4aac-8b98-6dfc5828b46b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:39.261534 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dfa77877-7607-4aac-8b98-6dfc5828b46b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:39.262012 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dfa77877-7607-4aac-8b98-6dfc5828b46b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:39.262805 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dfa77877-7607-4aac-8b98-6dfc5828b46b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:39.263242 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dfa77877-7607-4aac-8b98-6dfc5828b46b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:39.339459 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-dfa77877-7607-4aac-8b98-6dfc5828b46b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088214 Nov 08 16:19:39.340059 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 586/1163] 10.222.0.37 () {60 vars in 1315 bytes} [Mon Nov 8 16:19:39 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:19:40.475348 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-0812eeec-0660-48f4-802d-f3f6c6ae1cdb req-7281e232-9f98-42e6-8a1b-168af9e0becc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:40.476827 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:19:40.476827 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:19:40.481286 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-25fb37f1-cc9c-4eb8-9c59-81c8aa2f1805 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:40.482383 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-25fb37f1-cc9c-4eb8-9c59-81c8aa2f1805 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:40.483959 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-0812eeec-0660-48f4-802d-f3f6c6ae1cdb req-7281e232-9f98-42e6-8a1b-168af9e0becc service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:40.484403 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-0812eeec-0660-48f4-802d-f3f6c6ae1cdb req-7281e232-9f98-42e6-8a1b-168af9e0becc service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:40.489538 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25fb37f1-cc9c-4eb8-9c59-81c8aa2f1805 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:40.490017 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25fb37f1-cc9c-4eb8-9c59-81c8aa2f1805 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:40.491111 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25fb37f1-cc9c-4eb8-9c59-81c8aa2f1805 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:40.491608 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25fb37f1-cc9c-4eb8-9c59-81c8aa2f1805 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:40.496078 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-0812eeec-0660-48f4-802d-f3f6c6ae1cdb req-7281e232-9f98-42e6-8a1b-168af9e0becc service nova] Creating event network-changed:b3094cea-72ef-41cf-ac88-a6d678f0fb09 for instance f0c4ded0-3419-458b-ab12-da310a2b2fd7 on hv-cinder-81618 Nov 08 16:19:40.501332 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-0812eeec-0660-48f4-802d-f3f6c6ae1cdb req-7281e232-9f98-42e6-8a1b-168af9e0becc service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029937 Nov 08 16:19:40.502156 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 587/1164] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:19:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:19:40.559291 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-25fb37f1-cc9c-4eb8-9c59-81c8aa2f1805 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 14 microversion: 2.20 time: 0.090574 Nov 08 16:19:40.562708 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 578/1165] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:19:40 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:19:41.571175 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-60017409-4fb1-41ee-ab93-c4a557a162a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:41.572795 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-60017409-4fb1-41ee-ab93-c4a557a162a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:41.578796 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-60017409-4fb1-41ee-ab93-c4a557a162a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:41.579240 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-60017409-4fb1-41ee-ab93-c4a557a162a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:41.580003 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-60017409-4fb1-41ee-ab93-c4a557a162a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:41.580431 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-60017409-4fb1-41ee-ab93-c4a557a162a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:41.645145 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-60017409-4fb1-41ee-ab93-c4a557a162a8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 14 microversion: 2.20 time: 0.078372 Nov 08 16:19:41.645757 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 588/1166] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:19:41 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:19:42.656619 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8f664f64-77f9-448b-b5d9-f59efee66f98 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:42.657525 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8f664f64-77f9-448b-b5d9-f59efee66f98 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:42.664345 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8f664f64-77f9-448b-b5d9-f59efee66f98 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:42.664786 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8f664f64-77f9-448b-b5d9-f59efee66f98 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:42.666175 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8f664f64-77f9-448b-b5d9-f59efee66f98 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:42.666605 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8f664f64-77f9-448b-b5d9-f59efee66f98 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:42.728136 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8f664f64-77f9-448b-b5d9-f59efee66f98 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 14 microversion: 2.20 time: 0.075021 Nov 08 16:19:42.728737 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 579/1167] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:19:42 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:19:43.739414 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d8aff642-4310-497d-9601-67613bb18c74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:43.740335 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d8aff642-4310-497d-9601-67613bb18c74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:43.747934 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d8aff642-4310-497d-9601-67613bb18c74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:43.748376 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d8aff642-4310-497d-9601-67613bb18c74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:43.749130 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d8aff642-4310-497d-9601-67613bb18c74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:43.749558 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d8aff642-4310-497d-9601-67613bb18c74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:43.810362 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d8aff642-4310-497d-9601-67613bb18c74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 14 microversion: 2.20 time: 0.074900 Nov 08 16:19:43.812100 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 589/1168] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:19:43 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:19:44.822762 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f6f32f79-7768-4d25-ab0a-f3c450eed4c7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:44.823744 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f6f32f79-7768-4d25-ab0a-f3c450eed4c7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:44.830601 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f6f32f79-7768-4d25-ab0a-f3c450eed4c7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:44.831040 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f6f32f79-7768-4d25-ab0a-f3c450eed4c7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:44.831797 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f6f32f79-7768-4d25-ab0a-f3c450eed4c7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:44.832241 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f6f32f79-7768-4d25-ab0a-f3c450eed4c7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:44.890301 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f6f32f79-7768-4d25-ab0a-f3c450eed4c7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 14 microversion: 2.20 time: 0.071510 Nov 08 16:19:44.890901 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 580/1169] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:19:44 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:19:45.901040 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4b87dc69-858c-46d8-8875-70d98f5e9a4f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:45.901976 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4b87dc69-858c-46d8-8875-70d98f5e9a4f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:45.908682 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b87dc69-858c-46d8-8875-70d98f5e9a4f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:45.909127 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b87dc69-858c-46d8-8875-70d98f5e9a4f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:45.910003 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b87dc69-858c-46d8-8875-70d98f5e9a4f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:45.910431 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b87dc69-858c-46d8-8875-70d98f5e9a4f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:45.968726 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4b87dc69-858c-46d8-8875-70d98f5e9a4f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 14 microversion: 2.20 time: 0.071804 Nov 08 16:19:45.969330 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 590/1170] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:19:45 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:19:46.980082 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1d1d228e-eaff-4b86-8986-1345798b06a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:46.981061 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1d1d228e-eaff-4b86-8986-1345798b06a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:46.987807 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1d1d228e-eaff-4b86-8986-1345798b06a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:46.988249 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1d1d228e-eaff-4b86-8986-1345798b06a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:46.989009 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1d1d228e-eaff-4b86-8986-1345798b06a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:46.989429 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1d1d228e-eaff-4b86-8986-1345798b06a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:47.061330 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1d1d228e-eaff-4b86-8986-1345798b06a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 14 microversion: 2.20 time: 0.085307 Nov 08 16:19:47.061954 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 581/1171] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:19:46 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:19:48.073469 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e1a456f3-406a-4aeb-90b9-7b100d23c134 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:48.074492 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e1a456f3-406a-4aeb-90b9-7b100d23c134 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:48.081511 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e1a456f3-406a-4aeb-90b9-7b100d23c134 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:48.082003 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e1a456f3-406a-4aeb-90b9-7b100d23c134 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:48.082784 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e1a456f3-406a-4aeb-90b9-7b100d23c134 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:48.083219 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e1a456f3-406a-4aeb-90b9-7b100d23c134 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:48.143797 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e1a456f3-406a-4aeb-90b9-7b100d23c134 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 14 microversion: 2.20 time: 0.074823 Nov 08 16:19:48.144477 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 591/1172] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:19:48 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:19:49.155415 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9e66f8aa-ab23-48cc-9142-964292420247 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:49.156428 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-9e66f8aa-ab23-48cc-9142-964292420247 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:49.163242 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9e66f8aa-ab23-48cc-9142-964292420247 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:49.163680 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9e66f8aa-ab23-48cc-9142-964292420247 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:49.164439 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9e66f8aa-ab23-48cc-9142-964292420247 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:49.165144 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9e66f8aa-ab23-48cc-9142-964292420247 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:49.225729 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-9e66f8aa-ab23-48cc-9142-964292420247 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 14 microversion: 2.20 time: 0.074351 Nov 08 16:19:49.226323 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 582/1173] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:19:49 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:19:49.926689 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-888092bc-0bbb-4382-a043-98525486404d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:49.927627 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-888092bc-0bbb-4382-a043-98525486404d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:49.935075 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-888092bc-0bbb-4382-a043-98525486404d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:49.935519 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-888092bc-0bbb-4382-a043-98525486404d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:49.936279 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-888092bc-0bbb-4382-a043-98525486404d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:49.936704 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-888092bc-0bbb-4382-a043-98525486404d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:50.006432 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-888092bc-0bbb-4382-a043-98525486404d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "POST /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912/action" status: 202 len: 0 microversion: 2.1 time: 0.083990 Nov 08 16:19:50.010520 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 592/1174] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:19:49 2021] POST /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:19:50.016270 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-396c2415-2efb-485c-9c7c-11de97dcd3a8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:50.016950 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-396c2415-2efb-485c-9c7c-11de97dcd3a8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:50.023976 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-396c2415-2efb-485c-9c7c-11de97dcd3a8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:50.024457 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-396c2415-2efb-485c-9c7c-11de97dcd3a8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:50.025299 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-396c2415-2efb-485c-9c7c-11de97dcd3a8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:50.025750 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-396c2415-2efb-485c-9c7c-11de97dcd3a8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:50.238957 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1865da2c-f29a-4e21-b50c-b3603b436028 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:50.239973 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1865da2c-f29a-4e21-b50c-b3603b436028 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:50.246571 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1865da2c-f29a-4e21-b50c-b3603b436028 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:50.247022 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1865da2c-f29a-4e21-b50c-b3603b436028 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:50.247793 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1865da2c-f29a-4e21-b50c-b3603b436028 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:50.248228 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1865da2c-f29a-4e21-b50c-b3603b436028 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:50.256702 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-396c2415-2efb-485c-9c7c-11de97dcd3a8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:50.264470 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-396c2415-2efb-485c-9c7c-11de97dcd3a8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1750 microversion: 2.1 time: 0.252411 Nov 08 16:19:50.265412 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 583/1175] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:19:50 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1750 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:19:50.312678 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1865da2c-f29a-4e21-b50c-b3603b436028 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 14 microversion: 2.20 time: 0.079158 Nov 08 16:19:50.315737 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 593/1176] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:19:50 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:19:51.281451 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-7fdc935c-fe8a-46ef-8432-9f7ece47d27b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:51.282083 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-7fdc935c-fe8a-46ef-8432-9f7ece47d27b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:51.288240 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7fdc935c-fe8a-46ef-8432-9f7ece47d27b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:51.288676 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7fdc935c-fe8a-46ef-8432-9f7ece47d27b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:51.289438 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7fdc935c-fe8a-46ef-8432-9f7ece47d27b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:51.290767 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7fdc935c-fe8a-46ef-8432-9f7ece47d27b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:51.324440 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-261b8a22-3628-45f4-a764-f07b5ac9c15f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:51.325544 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-261b8a22-3628-45f4-a764-f07b5ac9c15f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:51.332871 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-261b8a22-3628-45f4-a764-f07b5ac9c15f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:51.333321 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-261b8a22-3628-45f4-a764-f07b5ac9c15f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:51.334132 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-261b8a22-3628-45f4-a764-f07b5ac9c15f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:51.334626 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-261b8a22-3628-45f4-a764-f07b5ac9c15f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:51.432584 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-261b8a22-3628-45f4-a764-f07b5ac9c15f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 6451 microversion: 2.20 time: 0.112539 Nov 08 16:19:51.433219 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 594/1177] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:19:51 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 6451 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:19:51.433858 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7fdc935c-fe8a-46ef-8432-9f7ece47d27b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:51.442411 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-7fdc935c-fe8a-46ef-8432-9f7ece47d27b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1755 microversion: 2.1 time: 0.164580 Nov 08 16:19:51.443199 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 584/1178] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:19:51 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:19:52.443205 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-db7d167a-1d31-42df-8107-70b83847756c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:52.444119 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-db7d167a-1d31-42df-8107-70b83847756c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:52.450993 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-db7d167a-1d31-42df-8107-70b83847756c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:52.451438 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-db7d167a-1d31-42df-8107-70b83847756c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:52.452204 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-db7d167a-1d31-42df-8107-70b83847756c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:52.452642 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-db7d167a-1d31-42df-8107-70b83847756c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:52.460029 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-7f4ce34b-8ab8-4a0c-9e1c-dc6e2650c4fd tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:52.460763 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-7f4ce34b-8ab8-4a0c-9e1c-dc6e2650c4fd tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:52.466969 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7f4ce34b-8ab8-4a0c-9e1c-dc6e2650c4fd tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:52.467406 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7f4ce34b-8ab8-4a0c-9e1c-dc6e2650c4fd tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:52.468174 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7f4ce34b-8ab8-4a0c-9e1c-dc6e2650c4fd tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:52.468596 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7f4ce34b-8ab8-4a0c-9e1c-dc6e2650c4fd tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:52.531054 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-db7d167a-1d31-42df-8107-70b83847756c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 14203 microversion: 2.20 time: 0.091757 Nov 08 16:19:52.531699 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 595/1179] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:19:52 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 14203 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:19:52.612993 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7f4ce34b-8ab8-4a0c-9e1c-dc6e2650c4fd tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:52.621420 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-7f4ce34b-8ab8-4a0c-9e1c-dc6e2650c4fd tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1755 microversion: 2.1 time: 0.165201 Nov 08 16:19:52.622026 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 585/1180] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:19:52 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:19:53.542874 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c7c1d827-6c41-48be-ba83-c6ee6d2bdb74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:53.543903 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c7c1d827-6c41-48be-ba83-c6ee6d2bdb74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:53.550736 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c7c1d827-6c41-48be-ba83-c6ee6d2bdb74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:53.551187 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c7c1d827-6c41-48be-ba83-c6ee6d2bdb74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:53.551951 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c7c1d827-6c41-48be-ba83-c6ee6d2bdb74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:53.552386 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c7c1d827-6c41-48be-ba83-c6ee6d2bdb74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:53.623305 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c7c1d827-6c41-48be-ba83-c6ee6d2bdb74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 18208 microversion: 2.20 time: 0.084467 Nov 08 16:19:53.623939 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 596/1181] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:19:53 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 18208 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:19:53.638598 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-fae2d8d6-f22f-4381-b7b4-f0f72d2c367e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:53.639196 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fae2d8d6-f22f-4381-b7b4-f0f72d2c367e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:53.645436 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fae2d8d6-f22f-4381-b7b4-f0f72d2c367e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:53.645909 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fae2d8d6-f22f-4381-b7b4-f0f72d2c367e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:53.646665 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fae2d8d6-f22f-4381-b7b4-f0f72d2c367e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:53.647085 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fae2d8d6-f22f-4381-b7b4-f0f72d2c367e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:53.785117 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fae2d8d6-f22f-4381-b7b4-f0f72d2c367e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:53.792923 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-fae2d8d6-f22f-4381-b7b4-f0f72d2c367e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1755 microversion: 2.1 time: 0.157884 Nov 08 16:19:53.793497 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 586/1182] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:19:53 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:19:54.634809 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-683a21c2-35b0-432c-b81c-1b8e9e137ec2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:54.635817 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-683a21c2-35b0-432c-b81c-1b8e9e137ec2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:54.642710 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-683a21c2-35b0-432c-b81c-1b8e9e137ec2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:54.643184 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-683a21c2-35b0-432c-b81c-1b8e9e137ec2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:54.643953 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-683a21c2-35b0-432c-b81c-1b8e9e137ec2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:54.644389 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-683a21c2-35b0-432c-b81c-1b8e9e137ec2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:54.719851 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-683a21c2-35b0-432c-b81c-1b8e9e137ec2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 19024 microversion: 2.20 time: 0.089548 Nov 08 16:19:54.720454 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 597/1183] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:19:54 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 19024 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:19:54.809041 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-60bba265-0b53-4ecb-ac79-81e2fc0050ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:54.809679 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-60bba265-0b53-4ecb-ac79-81e2fc0050ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:54.815905 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-60bba265-0b53-4ecb-ac79-81e2fc0050ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:54.816352 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-60bba265-0b53-4ecb-ac79-81e2fc0050ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:54.817120 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-60bba265-0b53-4ecb-ac79-81e2fc0050ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:54.817547 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-60bba265-0b53-4ecb-ac79-81e2fc0050ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:54.959590 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-60bba265-0b53-4ecb-ac79-81e2fc0050ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:54.967510 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-60bba265-0b53-4ecb-ac79-81e2fc0050ff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1755 microversion: 2.1 time: 0.162121 Nov 08 16:19:54.968075 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 587/1184] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:19:54 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:19:55.450985 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f7785207-a3c4-4a96-8062-a4f0debfcde2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:55.452004 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f7785207-a3c4-4a96-8062-a4f0debfcde2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:55.458798 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f7785207-a3c4-4a96-8062-a4f0debfcde2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:55.459250 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f7785207-a3c4-4a96-8062-a4f0debfcde2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:55.460018 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f7785207-a3c4-4a96-8062-a4f0debfcde2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:55.460456 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f7785207-a3c4-4a96-8062-a4f0debfcde2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:55.488948 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f7785207-a3c4-4a96-8062-a4f0debfcde2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042057 Nov 08 16:19:55.489486 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 598/1185] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:19:55 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 08 16:19:55.543618 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:55.544112 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:55.549980 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:55.550428 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:55.551204 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:55.551637 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:55.575771 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Going to try to terminate instance {{(pid=115523) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:19:55.648555 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "DELETE /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 204 len: 0 microversion: 2.1 time: 0.108652 Nov 08 16:19:55.649305 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 588/1186] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:19:55 2021] DELETE /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:19:55.657197 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-6686037b-38eb-4e3f-a893-96fb9d46b777 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:55.657816 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-6686037b-38eb-4e3f-a893-96fb9d46b777 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:55.663985 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6686037b-38eb-4e3f-a893-96fb9d46b777 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:55.664952 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6686037b-38eb-4e3f-a893-96fb9d46b777 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:55.665741 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6686037b-38eb-4e3f-a893-96fb9d46b777 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:55.666173 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6686037b-38eb-4e3f-a893-96fb9d46b777 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:55.731956 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e41c928b-1cee-44eb-b87b-4bfe4f7d445f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:55.732972 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e41c928b-1cee-44eb-b87b-4bfe4f7d445f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:55.738968 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e41c928b-1cee-44eb-b87b-4bfe4f7d445f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:55.739418 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e41c928b-1cee-44eb-b87b-4bfe4f7d445f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:55.740192 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e41c928b-1cee-44eb-b87b-4bfe4f7d445f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:55.740622 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e41c928b-1cee-44eb-b87b-4bfe4f7d445f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:55.796412 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-6686037b-38eb-4e3f-a893-96fb9d46b777 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:55.803840 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-6686037b-38eb-4e3f-a893-96fb9d46b777 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1671 microversion: 2.1 time: 0.150290 Nov 08 16:19:55.804400 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 599/1187] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:19:55 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:19:55.825272 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e41c928b-1cee-44eb-b87b-4bfe4f7d445f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 21288 microversion: 2.20 time: 0.098279 Nov 08 16:19:55.825935 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 589/1188] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:19:55 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 21288 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:19:55.984368 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d4e2909c-d330-45f3-a6bd-7d20b0b16712 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:55.984910 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d4e2909c-d330-45f3-a6bd-7d20b0b16712 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:55.991183 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d4e2909c-d330-45f3-a6bd-7d20b0b16712 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:55.991684 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d4e2909c-d330-45f3-a6bd-7d20b0b16712 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:55.993219 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d4e2909c-d330-45f3-a6bd-7d20b0b16712 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:55.993659 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d4e2909c-d330-45f3-a6bd-7d20b0b16712 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:56.139031 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-d4e2909c-d330-45f3-a6bd-7d20b0b16712 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:56.146811 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d4e2909c-d330-45f3-a6bd-7d20b0b16712 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1755 microversion: 2.1 time: 0.166214 Nov 08 16:19:56.147400 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 600/1189] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:19:55 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:19:56.822515 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-111d50c9-3bc3-4034-9cdd-f91e8fb9bedd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:56.823206 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-111d50c9-3bc3-4034-9cdd-f91e8fb9bedd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:56.830057 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-111d50c9-3bc3-4034-9cdd-f91e8fb9bedd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:56.830642 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-111d50c9-3bc3-4034-9cdd-f91e8fb9bedd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:56.831258 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-111d50c9-3bc3-4034-9cdd-f91e8fb9bedd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:56.831747 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-111d50c9-3bc3-4034-9cdd-f91e8fb9bedd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:56.836128 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-6b4b4a1b-bef6-4085-ba7a-270b86015901 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:56.837094 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-6b4b4a1b-bef6-4085-ba7a-270b86015901 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:56.843270 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6b4b4a1b-bef6-4085-ba7a-270b86015901 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:56.843709 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6b4b4a1b-bef6-4085-ba7a-270b86015901 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:56.844486 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6b4b4a1b-bef6-4085-ba7a-270b86015901 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:56.844891 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6b4b4a1b-bef6-4085-ba7a-270b86015901 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:56.959091 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-111d50c9-3bc3-4034-9cdd-f91e8fb9bedd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:56.966861 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-111d50c9-3bc3-4034-9cdd-f91e8fb9bedd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1671 microversion: 2.1 time: 0.149034 Nov 08 16:19:56.967421 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 590/1190] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:19:56 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1671 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:19:57.000163 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-6b4b4a1b-bef6-4085-ba7a-270b86015901 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 22978 microversion: 2.20 time: 0.167514 Nov 08 16:19:57.000814 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 601/1191] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:19:56 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 22978 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:19:57.164779 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9070f3b3-5e71-4c74-ab5e-051f346025cb tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:57.165459 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-9070f3b3-5e71-4c74-ab5e-051f346025cb tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:57.171576 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9070f3b3-5e71-4c74-ab5e-051f346025cb tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:57.172018 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9070f3b3-5e71-4c74-ab5e-051f346025cb tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:57.172783 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9070f3b3-5e71-4c74-ab5e-051f346025cb tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:57.173222 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9070f3b3-5e71-4c74-ab5e-051f346025cb tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:57.400048 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-9070f3b3-5e71-4c74-ab5e-051f346025cb tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:57.407834 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-9070f3b3-5e71-4c74-ab5e-051f346025cb tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1755 microversion: 2.1 time: 0.246969 Nov 08 16:19:57.408790 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 591/1192] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:19:57 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1755 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:19:57.985535 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-273531b1-000f-4c99-8432-a81f3640ef6c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:57.986250 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-273531b1-000f-4c99-8432-a81f3640ef6c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:57.994680 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-273531b1-000f-4c99-8432-a81f3640ef6c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:57.995126 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-273531b1-000f-4c99-8432-a81f3640ef6c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:57.996396 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-273531b1-000f-4c99-8432-a81f3640ef6c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:57.996898 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-273531b1-000f-4c99-8432-a81f3640ef6c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:58.011569 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-ee977531-6cf6-46ba-9959-6d1004eacf57 req-5bc160e6-9a13-4587-9d81-e774bf393e5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76ed94d-63f4-4597-be02-f3fc032b85aa", "name": "network-vif-deleted", "tag": "f4784d76-6af7-4b31-a9f3-ee25c9087b51"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:58.017446 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:19:58.017446 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:19:58.030825 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-ee977531-6cf6-46ba-9959-6d1004eacf57 req-5bc160e6-9a13-4587-9d81-e774bf393e5f service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:58.031255 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-ee977531-6cf6-46ba-9959-6d1004eacf57 req-5bc160e6-9a13-4587-9d81-e774bf393e5f service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:58.057765 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-ee977531-6cf6-46ba-9959-6d1004eacf57 req-5bc160e6-9a13-4587-9d81-e774bf393e5f service nova] Creating event network-vif-deleted:f4784d76-6af7-4b31-a9f3-ee25c9087b51 for instance b76ed94d-63f4-4597-be02-f3fc032b85aa on hv-cinder-81618 Nov 08 16:19:58.062878 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-ee977531-6cf6-46ba-9959-6d1004eacf57 req-5bc160e6-9a13-4587-9d81-e774bf393e5f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058438 Nov 08 16:19:58.063055 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-273531b1-000f-4c99-8432-a81f3640ef6c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:58.063735 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 592/1193] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:19:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:19:58.069181 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d2ab3fbf-720f-4dcf-883b-52162fdf8788 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:58.071899 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d2ab3fbf-720f-4dcf-883b-52162fdf8788 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:58.075646 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-273531b1-000f-4c99-8432-a81f3640ef6c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 200 len: 1604 microversion: 2.1 time: 0.094265 Nov 08 16:19:58.080669 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 602/1194] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:19:57 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 1604 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:19:58.084572 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d2ab3fbf-720f-4dcf-883b-52162fdf8788 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:58.085182 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d2ab3fbf-720f-4dcf-883b-52162fdf8788 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:58.086714 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d2ab3fbf-720f-4dcf-883b-52162fdf8788 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:58.087473 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d2ab3fbf-720f-4dcf-883b-52162fdf8788 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:58.179698 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d2ab3fbf-720f-4dcf-883b-52162fdf8788 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 24193 microversion: 2.20 time: 0.114296 Nov 08 16:19:58.182412 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 593/1195] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:19:58 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 24193 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:19:58.425892 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-dff42eee-f291-4144-b243-22ae5fa372f6 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:58.426767 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-dff42eee-f291-4144-b243-22ae5fa372f6 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:58.433743 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dff42eee-f291-4144-b243-22ae5fa372f6 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:58.434525 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dff42eee-f291-4144-b243-22ae5fa372f6 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:58.435319 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dff42eee-f291-4144-b243-22ae5fa372f6 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:58.435860 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dff42eee-f291-4144-b243-22ae5fa372f6 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:58.822191 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-dff42eee-f291-4144-b243-22ae5fa372f6 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:19:58.830164 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-dff42eee-f291-4144-b243-22ae5fa372f6 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1755 microversion: 2.1 time: 0.408448 Nov 08 16:19:58.830717 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 603/1196] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:19:58 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1755 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:19:59.093411 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-27e4d40d-141f-4ec1-b78c-93e44ff663ad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:59.094126 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-27e4d40d-141f-4ec1-b78c-93e44ff663ad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:59.101008 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-27e4d40d-141f-4ec1-b78c-93e44ff663ad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:59.101449 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-27e4d40d-141f-4ec1-b78c-93e44ff663ad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:59.102829 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-27e4d40d-141f-4ec1-b78c-93e44ff663ad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:59.103261 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-27e4d40d-141f-4ec1-b78c-93e44ff663ad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:59.118717 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-27e4d40d-141f-4ec1-b78c-93e44ff663ad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] HTTP exception thrown: Instance b76ed94d-63f4-4597-be02-f3fc032b85aa could not be found. Nov 08 16:19:59.119350 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-27e4d40d-141f-4ec1-b78c-93e44ff663ad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Returning 404 to user: Instance b76ed94d-63f4-4597-be02-f3fc032b85aa could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:19:59.120187 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-27e4d40d-141f-4ec1-b78c-93e44ff663ad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 404 len: 111 microversion: 2.1 time: 0.030898 Nov 08 16:19:59.120765 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 594/1197] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:19:59 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:19:59.128761 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9ad8f9dc-dd85-447f-babc-0fca41df93f7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '.version_select at 0x7f8c0747de50>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:59.146965 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9ad8f9dc-dd85-447f-babc-0fca41df93f7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447147253" status: 202 len: 0 microversion: 2.1 time: 0.021735 Nov 08 16:19:59.147519 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 604/1198] 10.222.0.37 () {58 vars in 1220 bytes} [Mon Nov 8 16:19:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447147253 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:19:59.193633 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-06c403a1-ffbf-471b-aa16-7e0ba434e729 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:59.194567 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-06c403a1-ffbf-471b-aa16-7e0ba434e729 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:59.201899 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-06c403a1-ffbf-471b-aa16-7e0ba434e729 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:59.203036 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-06c403a1-ffbf-471b-aa16-7e0ba434e729 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:59.204047 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-06c403a1-ffbf-471b-aa16-7e0ba434e729 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:59.204669 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-06c403a1-ffbf-471b-aa16-7e0ba434e729 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:59.287108 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-06c403a1-ffbf-471b-aa16-7e0ba434e729 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 25566 microversion: 2.20 time: 0.096894 Nov 08 16:19:59.287610 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 595/1199] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:19:59 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 25566 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:19:59.821469 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-79b711b9-1c90-488c-87d6-65093bd892fa tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'create', calling method: .version_select at 0x7f8c073d0ee0>, body: {"keypair": {"name": "tempest-keypair-486914827"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:19:59.835784 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-79b711b9-1c90-488c-87d6-65093bd892fa tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Getting quotas for project f6e779f0506643d08d984c2971d5a71c. Resources: {'key_pairs'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:19:59.839581 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-79b711b9-1c90-488c-87d6-65093bd892fa tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Getting quotas for user 3924bafb69cd45709eb3878837741eef and project f6e779f0506643d08d984c2971d5a71c. Resources: {'key_pairs'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:19:59.847045 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-25a6cc7f-4403-4606-a2ac-dc0b3c162c43 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:19:59.847752 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-25a6cc7f-4403-4606-a2ac-dc0b3c162c43 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:19:59.854731 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25a6cc7f-4403-4606-a2ac-dc0b3c162c43 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:59.855170 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25a6cc7f-4403-4606-a2ac-dc0b3c162c43 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:19:59.855936 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25a6cc7f-4403-4606-a2ac-dc0b3c162c43 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:19:59.856363 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-25a6cc7f-4403-4606-a2ac-dc0b3c162c43 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:00.001491 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-25a6cc7f-4403-4606-a2ac-dc0b3c162c43 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:20:00.009982 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-25a6cc7f-4403-4606-a2ac-dc0b3c162c43 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1755 microversion: 2.1 time: 0.166848 Nov 08 16:20:00.010635 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 596/1200] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:19:59 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:20:00.047556 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-79b711b9-1c90-488c-87d6-65093bd892fa tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Getting quotas for project f6e779f0506643d08d984c2971d5a71c. Resources: {'key_pairs'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:20:00.051151 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-79b711b9-1c90-488c-87d6-65093bd892fa tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Getting quotas for user 3924bafb69cd45709eb3878837741eef and project f6e779f0506643d08d984c2971d5a71c. Resources: {'key_pairs'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:20:00.064061 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-79b711b9-1c90-488c-87d6-65093bd892fa tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.247350 Nov 08 16:20:00.064647 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 605/1201] 10.222.0.37 () {60 vars in 1157 bytes} [Mon Nov 8 16:19:59 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:20:00.298724 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3bfec2b7-b2cc-49ff-be03-5443bd1cebee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:00.299638 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3bfec2b7-b2cc-49ff-be03-5443bd1cebee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:00.306893 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3bfec2b7-b2cc-49ff-be03-5443bd1cebee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:00.307964 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3bfec2b7-b2cc-49ff-be03-5443bd1cebee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:00.308168 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3bfec2b7-b2cc-49ff-be03-5443bd1cebee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:00.308921 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3bfec2b7-b2cc-49ff-be03-5443bd1cebee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:00.389029 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3bfec2b7-b2cc-49ff-be03-5443bd1cebee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 26866 microversion: 2.20 time: 0.093905 Nov 08 16:20:00.389689 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 597/1202] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:00 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 26866 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:01.027271 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-41ffe655-3fca-4afb-ac44-c5843e56d138 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:20:01.027906 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-41ffe655-3fca-4afb-ac44-c5843e56d138 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:01.033796 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-41ffe655-3fca-4afb-ac44-c5843e56d138 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:01.034249 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-41ffe655-3fca-4afb-ac44-c5843e56d138 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:01.035023 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-41ffe655-3fca-4afb-ac44-c5843e56d138 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:01.035459 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-41ffe655-3fca-4afb-ac44-c5843e56d138 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:01.180535 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-41ffe655-3fca-4afb-ac44-c5843e56d138 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:20:01.188714 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-41ffe655-3fca-4afb-ac44-c5843e56d138 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1755 microversion: 2.1 time: 0.166273 Nov 08 16:20:01.189333 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 606/1203] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:20:01 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:20:01.272128 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5cc6baa4-77e2-46b4-b550-aea86aae7162 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-264492874", "imageRef": "9abeafba-e602-4e0a-aab2-62160562de06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75fa9c3e-7bfe-490a-9118-221394c29646"}], "security_groups": [{"name": "tempest-securitygroup--1155485669"}], "key_name": "tempest-keypair-486914827", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:01.371385 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.network.neutron [None req-5cc6baa4-77e2-46b4-b550-aea86aae7162 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] validate_networks() for [('75fa9c3e-7bfe-490a-9118-221394c29646', None, None, None, None, None)] {{(pid=115523) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:20:01.400855 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9f459ba2-0fd4-4bfe-ad0e-438605d685f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:01.401814 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9f459ba2-0fd4-4bfe-ad0e-438605d685f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:01.407511 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9f459ba2-0fd4-4bfe-ad0e-438605d685f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:01.407948 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9f459ba2-0fd4-4bfe-ad0e-438605d685f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:01.408712 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9f459ba2-0fd4-4bfe-ad0e-438605d685f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:01.409137 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9f459ba2-0fd4-4bfe-ad0e-438605d685f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:01.499350 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9f459ba2-0fd4-4bfe-ad0e-438605d685f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 27673 microversion: 2.20 time: 0.102545 Nov 08 16:20:01.500028 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 607/1204] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:01 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 27673 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:01.730059 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-5cc6baa4-77e2-46b4-b550-aea86aae7162 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Flavor limits 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:20:01.730498 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-5cc6baa4-77e2-46b4-b550-aea86aae7162 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Image limits 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:20:01.730963 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-5cc6baa4-77e2-46b4-b550-aea86aae7162 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Flavor pref 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:20:01.731361 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-5cc6baa4-77e2-46b4-b550-aea86aae7162 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Image pref 0:0:0 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:20:01.731763 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.virt.hardware [None req-5cc6baa4-77e2-46b4-b550-aea86aae7162 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:20:01.740122 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5cc6baa4-77e2-46b4-b550-aea86aae7162 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:01.740558 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5cc6baa4-77e2-46b4-b550-aea86aae7162 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:01.741349 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5cc6baa4-77e2-46b4-b550-aea86aae7162 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:01.741801 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5cc6baa4-77e2-46b4-b550-aea86aae7162 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:01.758531 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-5cc6baa4-77e2-46b4-b550-aea86aae7162 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Getting quotas for project f6e779f0506643d08d984c2971d5a71c. Resources: {'instances', 'ram', 'cores'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:20:01.762323 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-5cc6baa4-77e2-46b4-b550-aea86aae7162 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Getting quotas for user 3924bafb69cd45709eb3878837741eef and project f6e779f0506643d08d984c2971d5a71c. Resources: {'instances', 'ram', 'cores'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:20:01.772569 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5cc6baa4-77e2-46b4-b550-aea86aae7162 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Going to run 1 instances... {{(pid=115523) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:20:01.775444 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5cc6baa4-77e2-46b4-b550-aea86aae7162 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9abeafba-e602-4e0a-aab2-62160562de06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:20:01.819016 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5cc6baa4-77e2-46b4-b550-aea86aae7162 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.551233 Nov 08 16:20:01.819653 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 598/1205] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Nov 8 16:20:01 2021] POST /compute/v2.1/servers => generated 402 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 16:20:01.831726 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-92406b6a-e90e-420a-817b-aadef61326dd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:20:01.832610 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-92406b6a-e90e-420a-817b-aadef61326dd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:01.888041 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-92406b6a-e90e-420a-817b-aadef61326dd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:20:01.894549 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-92406b6a-e90e-420a-817b-aadef61326dd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b" status: 200 len: 1236 microversion: 2.1 time: 0.068475 Nov 08 16:20:01.895095 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 608/1206] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:20:01 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:20:02.207904 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a371788d-877d-4e1d-a9c9-6da8941d36af tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:20:02.209050 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a371788d-877d-4e1d-a9c9-6da8941d36af tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:02.217790 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a371788d-877d-4e1d-a9c9-6da8941d36af tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:02.218225 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a371788d-877d-4e1d-a9c9-6da8941d36af tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:02.219007 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a371788d-877d-4e1d-a9c9-6da8941d36af tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:02.219429 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a371788d-877d-4e1d-a9c9-6da8941d36af tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:02.367722 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a371788d-877d-4e1d-a9c9-6da8941d36af tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:20:02.375874 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a371788d-877d-4e1d-a9c9-6da8941d36af tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1755 microversion: 2.1 time: 0.173728 Nov 08 16:20:02.376482 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 599/1207] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:20:02 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:20:02.511473 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-362deb34-b8bb-424f-b49b-dd8252248c44 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:02.512437 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-362deb34-b8bb-424f-b49b-dd8252248c44 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:02.519308 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-362deb34-b8bb-424f-b49b-dd8252248c44 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:02.519759 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-362deb34-b8bb-424f-b49b-dd8252248c44 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:02.520539 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-362deb34-b8bb-424f-b49b-dd8252248c44 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:02.520974 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-362deb34-b8bb-424f-b49b-dd8252248c44 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:02.599073 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-362deb34-b8bb-424f-b49b-dd8252248c44 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 27910 microversion: 2.20 time: 0.091678 Nov 08 16:20:02.599691 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 609/1208] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:02 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 27910 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:02.911261 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6f2ee88c-87f5-448b-afc9-eb7e2721dbb2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:20:02.911864 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6f2ee88c-87f5-448b-afc9-eb7e2721dbb2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:02.918194 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6f2ee88c-87f5-448b-afc9-eb7e2721dbb2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:02.918640 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6f2ee88c-87f5-448b-afc9-eb7e2721dbb2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:02.919549 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6f2ee88c-87f5-448b-afc9-eb7e2721dbb2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:02.919837 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6f2ee88c-87f5-448b-afc9-eb7e2721dbb2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:03.014691 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6f2ee88c-87f5-448b-afc9-eb7e2721dbb2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:20:03.021791 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6f2ee88c-87f5-448b-afc9-eb7e2721dbb2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b" status: 200 len: 1294 microversion: 2.1 time: 0.114154 Nov 08 16:20:03.022366 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 600/1209] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:20:02 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b => generated 1294 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:20:03.393909 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4cfd9540-a043-46bc-883e-27140eb646fa tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:20:03.394599 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4cfd9540-a043-46bc-883e-27140eb646fa tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:03.402044 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4cfd9540-a043-46bc-883e-27140eb646fa tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:03.402488 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4cfd9540-a043-46bc-883e-27140eb646fa tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:03.403269 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4cfd9540-a043-46bc-883e-27140eb646fa tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:03.403679 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4cfd9540-a043-46bc-883e-27140eb646fa tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:03.610619 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4ca9bcbc-01e4-46c4-9b5c-bf502ede8c1e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:03.612156 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4ca9bcbc-01e4-46c4-9b5c-bf502ede8c1e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:03.618628 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4ca9bcbc-01e4-46c4-9b5c-bf502ede8c1e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:03.619071 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4ca9bcbc-01e4-46c4-9b5c-bf502ede8c1e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:03.619841 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4ca9bcbc-01e4-46c4-9b5c-bf502ede8c1e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:03.620265 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4ca9bcbc-01e4-46c4-9b5c-bf502ede8c1e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:03.636555 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4cfd9540-a043-46bc-883e-27140eb646fa tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:20:03.650997 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4cfd9540-a043-46bc-883e-27140eb646fa tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1755 microversion: 2.1 time: 0.261129 Nov 08 16:20:03.651580 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 610/1210] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:20:03 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1755 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:20:03.710177 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4ca9bcbc-01e4-46c4-9b5c-bf502ede8c1e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28220 microversion: 2.20 time: 0.102870 Nov 08 16:20:03.711534 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 601/1211] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:03 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:04.039307 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c71e5059-c0ae-4454-a081-4cdb73441c61 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:20:04.039989 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c71e5059-c0ae-4454-a081-4cdb73441c61 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:04.046909 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c71e5059-c0ae-4454-a081-4cdb73441c61 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:04.047370 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c71e5059-c0ae-4454-a081-4cdb73441c61 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:04.048161 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c71e5059-c0ae-4454-a081-4cdb73441c61 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:04.048763 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c71e5059-c0ae-4454-a081-4cdb73441c61 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:04.217192 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-5d2894c7-8903-41ac-a7b6-470f316feaab req-f566cfc8-bac6-43f6-8452-a2631cc86831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c45dd64-42e8-48a5-8a86-f7ac61c15a2b", "tag": "a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:04.219548 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:20:04.219548 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:20:04.232548 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-5d2894c7-8903-41ac-a7b6-470f316feaab req-f566cfc8-bac6-43f6-8452-a2631cc86831 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:04.233164 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-5d2894c7-8903-41ac-a7b6-470f316feaab req-f566cfc8-bac6-43f6-8452-a2631cc86831 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:04.245464 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-5d2894c7-8903-41ac-a7b6-470f316feaab req-f566cfc8-bac6-43f6-8452-a2631cc86831 service nova] Creating event network-changed:a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 for instance 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b on hv-cinder-81618 Nov 08 16:20:04.251519 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-5d2894c7-8903-41ac-a7b6-470f316feaab req-f566cfc8-bac6-43f6-8452-a2631cc86831 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038522 Nov 08 16:20:04.252814 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 602/1212] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:20:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:20:04.282970 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c71e5059-c0ae-4454-a081-4cdb73441c61 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:20:04.295698 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c71e5059-c0ae-4454-a081-4cdb73441c61 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b" status: 200 len: 1362 microversion: 2.1 time: 0.260313 Nov 08 16:20:04.305821 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 611/1213] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:20:04 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:20:04.668983 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-63d706e3-6a76-4f7e-a445-6f06c47b4258 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:20:04.669677 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-63d706e3-6a76-4f7e-a445-6f06c47b4258 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:04.675655 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-63d706e3-6a76-4f7e-a445-6f06c47b4258 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:04.676120 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-63d706e3-6a76-4f7e-a445-6f06c47b4258 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:04.676894 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-63d706e3-6a76-4f7e-a445-6f06c47b4258 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:04.677343 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-63d706e3-6a76-4f7e-a445-6f06c47b4258 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:04.722243 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-36713de0-dc9a-4f79-a0ac-5707dfdeaabd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:04.723166 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-36713de0-dc9a-4f79-a0ac-5707dfdeaabd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:04.729386 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-36713de0-dc9a-4f79-a0ac-5707dfdeaabd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:04.729878 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-36713de0-dc9a-4f79-a0ac-5707dfdeaabd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:04.730670 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-36713de0-dc9a-4f79-a0ac-5707dfdeaabd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:04.731106 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-36713de0-dc9a-4f79-a0ac-5707dfdeaabd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:04.897019 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-63d706e3-6a76-4f7e-a445-6f06c47b4258 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:20:04.904758 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-63d706e3-6a76-4f7e-a445-6f06c47b4258 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1755 microversion: 2.1 time: 0.240258 Nov 08 16:20:04.905325 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 603/1214] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:20:04 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1755 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:20:05.042414 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-36713de0-dc9a-4f79-a0ac-5707dfdeaabd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28220 microversion: 2.20 time: 0.323632 Nov 08 16:20:05.043070 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 612/1215] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:04 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28220 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:05.312873 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3dc866df-459c-41bd-a355-1cd0f8453f0d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:20:05.313399 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3dc866df-459c-41bd-a355-1cd0f8453f0d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:05.319756 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3dc866df-459c-41bd-a355-1cd0f8453f0d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:05.320700 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3dc866df-459c-41bd-a355-1cd0f8453f0d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:05.321468 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3dc866df-459c-41bd-a355-1cd0f8453f0d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:05.321933 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3dc866df-459c-41bd-a355-1cd0f8453f0d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:05.450948 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-3dc866df-459c-41bd-a355-1cd0f8453f0d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:20:05.458183 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3dc866df-459c-41bd-a355-1cd0f8453f0d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b" status: 200 len: 1362 microversion: 2.1 time: 0.149129 Nov 08 16:20:05.458740 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 604/1216] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:20:05 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:20:05.922253 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-26983c54-385a-444a-9967-72ba8e750211 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:20:05.922945 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-26983c54-385a-444a-9967-72ba8e750211 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:05.929621 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-26983c54-385a-444a-9967-72ba8e750211 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:05.930096 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-26983c54-385a-444a-9967-72ba8e750211 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:05.930854 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-26983c54-385a-444a-9967-72ba8e750211 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:05.931282 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-26983c54-385a-444a-9967-72ba8e750211 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:06.054047 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-324c52ba-0ac8-403e-8cb6-df9cee11d762 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:06.054993 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-324c52ba-0ac8-403e-8cb6-df9cee11d762 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:06.061213 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-324c52ba-0ac8-403e-8cb6-df9cee11d762 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:06.061658 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-324c52ba-0ac8-403e-8cb6-df9cee11d762 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:06.062465 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-324c52ba-0ac8-403e-8cb6-df9cee11d762 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:06.062895 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-324c52ba-0ac8-403e-8cb6-df9cee11d762 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:06.072489 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-26983c54-385a-444a-9967-72ba8e750211 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:20:06.080373 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-26983c54-385a-444a-9967-72ba8e750211 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1755 microversion: 2.1 time: 0.162116 Nov 08 16:20:06.081025 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 613/1217] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:20:05 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:20:06.216051 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-324c52ba-0ac8-403e-8cb6-df9cee11d762 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28220 microversion: 2.20 time: 0.165434 Nov 08 16:20:06.216613 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 605/1218] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:06 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28220 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:06.475315 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-6aac2b7b-cd7a-4413-bd85-9e3442a0ccb1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:20:06.475842 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-6aac2b7b-cd7a-4413-bd85-9e3442a0ccb1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:06.482265 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6aac2b7b-cd7a-4413-bd85-9e3442a0ccb1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:06.482711 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6aac2b7b-cd7a-4413-bd85-9e3442a0ccb1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:06.483490 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6aac2b7b-cd7a-4413-bd85-9e3442a0ccb1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:06.483922 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6aac2b7b-cd7a-4413-bd85-9e3442a0ccb1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:06.614703 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-6aac2b7b-cd7a-4413-bd85-9e3442a0ccb1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:20:06.622650 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-6aac2b7b-cd7a-4413-bd85-9e3442a0ccb1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b" status: 200 len: 1362 microversion: 2.1 time: 0.151184 Nov 08 16:20:06.623211 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 614/1219] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:20:06 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:20:07.098457 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e78755da-a4f7-4aba-8415-432ca8b666de tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:20:07.099140 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e78755da-a4f7-4aba-8415-432ca8b666de tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:07.106472 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e78755da-a4f7-4aba-8415-432ca8b666de tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:07.106907 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e78755da-a4f7-4aba-8415-432ca8b666de tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:07.107672 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e78755da-a4f7-4aba-8415-432ca8b666de tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:07.108097 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e78755da-a4f7-4aba-8415-432ca8b666de tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:07.228184 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2a19dc71-82ae-456f-be79-c0a17a30d95e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:07.229136 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2a19dc71-82ae-456f-be79-c0a17a30d95e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:07.235295 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2a19dc71-82ae-456f-be79-c0a17a30d95e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:07.235743 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2a19dc71-82ae-456f-be79-c0a17a30d95e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:07.236515 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2a19dc71-82ae-456f-be79-c0a17a30d95e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:07.236952 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2a19dc71-82ae-456f-be79-c0a17a30d95e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:07.247068 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-e78755da-a4f7-4aba-8415-432ca8b666de tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:20:07.254820 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e78755da-a4f7-4aba-8415-432ca8b666de tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1758 microversion: 2.1 time: 0.160353 Nov 08 16:20:07.255457 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 606/1220] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:20:07 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:20:07.365802 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2a19dc71-82ae-456f-be79-c0a17a30d95e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28220 microversion: 2.20 time: 0.141665 Nov 08 16:20:07.366699 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 615/1221] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:07 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28220 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:07.639867 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d7e7f7ee-936d-41c1-8456-b82325337858 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:20:07.640544 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d7e7f7ee-936d-41c1-8456-b82325337858 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:07.646736 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d7e7f7ee-936d-41c1-8456-b82325337858 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:07.647180 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d7e7f7ee-936d-41c1-8456-b82325337858 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:07.647940 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d7e7f7ee-936d-41c1-8456-b82325337858 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:07.648948 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d7e7f7ee-936d-41c1-8456-b82325337858 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:07.783162 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d7e7f7ee-936d-41c1-8456-b82325337858 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:20:07.790874 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d7e7f7ee-936d-41c1-8456-b82325337858 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b" status: 200 len: 1362 microversion: 2.1 time: 0.155173 Nov 08 16:20:07.791625 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 607/1222] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:20:07 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:20:08.378172 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5f8dd760-2763-4338-9cc1-387bad30dd1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:08.379091 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5f8dd760-2763-4338-9cc1-387bad30dd1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:08.386526 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5f8dd760-2763-4338-9cc1-387bad30dd1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:08.386978 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5f8dd760-2763-4338-9cc1-387bad30dd1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:08.387752 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5f8dd760-2763-4338-9cc1-387bad30dd1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:08.388187 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5f8dd760-2763-4338-9cc1-387bad30dd1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:08.448035 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5f8dd760-2763-4338-9cc1-387bad30dd1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28220 microversion: 2.20 time: 0.073989 Nov 08 16:20:08.448649 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 616/1223] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:08 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28220 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:08.807789 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-292e702b-c216-4c95-9a78-b2e1db0c7a62 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:20:08.808382 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-292e702b-c216-4c95-9a78-b2e1db0c7a62 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:08.814716 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-292e702b-c216-4c95-9a78-b2e1db0c7a62 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:08.815154 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-292e702b-c216-4c95-9a78-b2e1db0c7a62 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:08.815916 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-292e702b-c216-4c95-9a78-b2e1db0c7a62 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:08.816340 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-292e702b-c216-4c95-9a78-b2e1db0c7a62 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:08.947031 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-292e702b-c216-4c95-9a78-b2e1db0c7a62 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:20:08.954236 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-292e702b-c216-4c95-9a78-b2e1db0c7a62 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b" status: 200 len: 1362 microversion: 2.1 time: 0.150576 Nov 08 16:20:08.954807 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 608/1224] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:20:08 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:20:09.460253 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7800719d-4683-449d-b9ee-40e864faff43 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:09.461284 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7800719d-4683-449d-b9ee-40e864faff43 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:09.468151 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7800719d-4683-449d-b9ee-40e864faff43 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:09.468621 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7800719d-4683-449d-b9ee-40e864faff43 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:09.469389 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7800719d-4683-449d-b9ee-40e864faff43 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:09.469842 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7800719d-4683-449d-b9ee-40e864faff43 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:09.533649 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7800719d-4683-449d-b9ee-40e864faff43 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28220 microversion: 2.20 time: 0.077395 Nov 08 16:20:09.534302 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 617/1225] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:09 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:09.970675 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c6599ded-6d90-4a51-84e0-40e12336b3b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:20:09.971280 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c6599ded-6d90-4a51-84e0-40e12336b3b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:09.977555 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c6599ded-6d90-4a51-84e0-40e12336b3b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:09.978029 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c6599ded-6d90-4a51-84e0-40e12336b3b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:09.978799 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c6599ded-6d90-4a51-84e0-40e12336b3b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:09.979229 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c6599ded-6d90-4a51-84e0-40e12336b3b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:10.105728 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c6599ded-6d90-4a51-84e0-40e12336b3b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:20:10.113542 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c6599ded-6d90-4a51-84e0-40e12336b3b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b" status: 200 len: 1362 microversion: 2.1 time: 0.146477 Nov 08 16:20:10.114114 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 609/1226] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:20:09 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:20:10.544998 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4b9e1025-d462-40b2-b94e-a6873c8685e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:10.546031 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4b9e1025-d462-40b2-b94e-a6873c8685e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:10.552737 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b9e1025-d462-40b2-b94e-a6873c8685e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:10.553186 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b9e1025-d462-40b2-b94e-a6873c8685e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:10.553983 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b9e1025-d462-40b2-b94e-a6873c8685e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:10.554452 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4b9e1025-d462-40b2-b94e-a6873c8685e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:10.624336 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4b9e1025-d462-40b2-b94e-a6873c8685e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28220 microversion: 2.20 time: 0.083228 Nov 08 16:20:10.625035 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 618/1227] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:10 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:10.638198 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-5c65c1eb-fcf7-4c4d-ad3f-af87e799c34a req-5ff2c60a-4a4f-47d3-9c3d-d602ff8d47c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c45dd64-42e8-48a5-8a86-f7ac61c15a2b", "name": "network-vif-plugged", "status": "completed", "tag": "a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:10.639719 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:20:10.639719 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:20:10.646977 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-5c65c1eb-fcf7-4c4d-ad3f-af87e799c34a req-5ff2c60a-4a4f-47d3-9c3d-d602ff8d47c5 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:10.647408 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-5c65c1eb-fcf7-4c4d-ad3f-af87e799c34a req-5ff2c60a-4a4f-47d3-9c3d-d602ff8d47c5 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:10.659180 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-5c65c1eb-fcf7-4c4d-ad3f-af87e799c34a req-5ff2c60a-4a4f-47d3-9c3d-d602ff8d47c5 service nova] Creating event network-vif-plugged:a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 for instance 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b on hv-cinder-81618 Nov 08 16:20:10.664290 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-5c65c1eb-fcf7-4c4d-ad3f-af87e799c34a req-5ff2c60a-4a4f-47d3-9c3d-d602ff8d47c5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029261 Nov 08 16:20:10.664867 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 610/1228] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:20:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:20:11.131374 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7c6f2cd6-678f-4832-ad81-97b3cd4eb361 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:20:11.132084 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7c6f2cd6-678f-4832-ad81-97b3cd4eb361 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:11.140063 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7c6f2cd6-678f-4832-ad81-97b3cd4eb361 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:11.140506 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7c6f2cd6-678f-4832-ad81-97b3cd4eb361 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:11.141265 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7c6f2cd6-678f-4832-ad81-97b3cd4eb361 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:11.141694 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7c6f2cd6-678f-4832-ad81-97b3cd4eb361 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:11.271475 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7c6f2cd6-678f-4832-ad81-97b3cd4eb361 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:20:11.279844 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7c6f2cd6-678f-4832-ad81-97b3cd4eb361 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b" status: 200 len: 1362 microversion: 2.1 time: 0.152609 Nov 08 16:20:11.280399 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 619/1229] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:20:11 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:20:11.637278 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-00f10b61-56c6-4202-a670-bafdf3cfe4d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:11.638289 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-00f10b61-56c6-4202-a670-bafdf3cfe4d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:11.644272 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-00f10b61-56c6-4202-a670-bafdf3cfe4d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:11.644715 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-00f10b61-56c6-4202-a670-bafdf3cfe4d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:11.645477 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-00f10b61-56c6-4202-a670-bafdf3cfe4d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:11.645931 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-00f10b61-56c6-4202-a670-bafdf3cfe4d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:11.746969 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-00f10b61-56c6-4202-a670-bafdf3cfe4d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28220 microversion: 2.20 time: 0.114648 Nov 08 16:20:11.747610 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 611/1230] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:11 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28220 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:12.295462 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e2985fa3-8a6b-47ad-89f2-a9d3aea98355 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:20:12.296128 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e2985fa3-8a6b-47ad-89f2-a9d3aea98355 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:12.303645 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e2985fa3-8a6b-47ad-89f2-a9d3aea98355 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:12.304143 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e2985fa3-8a6b-47ad-89f2-a9d3aea98355 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:12.304917 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e2985fa3-8a6b-47ad-89f2-a9d3aea98355 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:12.305746 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e2985fa3-8a6b-47ad-89f2-a9d3aea98355 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:12.439208 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e2985fa3-8a6b-47ad-89f2-a9d3aea98355 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:20:12.446459 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e2985fa3-8a6b-47ad-89f2-a9d3aea98355 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b" status: 200 len: 1362 microversion: 2.1 time: 0.154649 Nov 08 16:20:12.447136 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 620/1231] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:20:12 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:20:12.759468 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-bb97f3d6-a2b6-47c7-91d0-2cce9b3f2ce8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:12.760462 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-bb97f3d6-a2b6-47c7-91d0-2cce9b3f2ce8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:12.767362 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bb97f3d6-a2b6-47c7-91d0-2cce9b3f2ce8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:12.767813 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bb97f3d6-a2b6-47c7-91d0-2cce9b3f2ce8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:12.768599 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bb97f3d6-a2b6-47c7-91d0-2cce9b3f2ce8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:12.769017 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bb97f3d6-a2b6-47c7-91d0-2cce9b3f2ce8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:12.835111 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-bb97f3d6-a2b6-47c7-91d0-2cce9b3f2ce8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28220 microversion: 2.20 time: 0.079727 Nov 08 16:20:12.835729 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 612/1232] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:12 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:13.463883 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-df499543-3b85-439e-adb1-79eb15ccf287 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:20:13.464434 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-df499543-3b85-439e-adb1-79eb15ccf287 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:13.470727 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-df499543-3b85-439e-adb1-79eb15ccf287 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:13.471179 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-df499543-3b85-439e-adb1-79eb15ccf287 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:13.471983 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-df499543-3b85-439e-adb1-79eb15ccf287 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:13.472423 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-df499543-3b85-439e-adb1-79eb15ccf287 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:13.597469 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-df499543-3b85-439e-adb1-79eb15ccf287 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:20:13.604739 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-df499543-3b85-439e-adb1-79eb15ccf287 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b" status: 200 len: 1547 microversion: 2.1 time: 0.145187 Nov 08 16:20:13.605298 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 621/1233] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:20:13 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b => generated 1547 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:20:13.621412 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-84a8e765-5a34-4182-9332-ed21726f096b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:20:13.622016 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-84a8e765-5a34-4182-9332-ed21726f096b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:13.628687 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84a8e765-5a34-4182-9332-ed21726f096b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:13.629124 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84a8e765-5a34-4182-9332-ed21726f096b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:13.629923 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84a8e765-5a34-4182-9332-ed21726f096b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:13.630353 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-84a8e765-5a34-4182-9332-ed21726f096b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:13.707349 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-84a8e765-5a34-4182-9332-ed21726f096b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090108 Nov 08 16:20:13.707939 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 613/1234] 10.222.0.37 () {58 vars in 1274 bytes} [Mon Nov 8 16:20:13 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:20:13.846523 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-51cb1975-3cd3-4afc-a3de-fe1341dcb574 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:13.847538 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-51cb1975-3cd3-4afc-a3de-fe1341dcb574 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:13.853977 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-51cb1975-3cd3-4afc-a3de-fe1341dcb574 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:13.854426 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-51cb1975-3cd3-4afc-a3de-fe1341dcb574 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:13.855230 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-51cb1975-3cd3-4afc-a3de-fe1341dcb574 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:13.855814 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-51cb1975-3cd3-4afc-a3de-fe1341dcb574 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:13.922576 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-51cb1975-3cd3-4afc-a3de-fe1341dcb574 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28220 microversion: 2.20 time: 0.079580 Nov 08 16:20:13.926560 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 622/1235] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:13 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:14.840997 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-0f6639f5-cd1c-4f83-972d-f8017fcec193 req-bc80dbca-f773-46ac-b58d-708ea3a21265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c45dd64-42e8-48a5-8a86-f7ac61c15a2b", "tag": "a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:14.844395 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a4dab0be-4b6e-4064-89d3-d9ab2a09bb45 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:14.845289 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a4dab0be-4b6e-4064-89d3-d9ab2a09bb45 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:14.847652 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:20:14.847652 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:20:14.852597 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a4dab0be-4b6e-4064-89d3-d9ab2a09bb45 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:14.853562 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a4dab0be-4b6e-4064-89d3-d9ab2a09bb45 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:14.854073 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a4dab0be-4b6e-4064-89d3-d9ab2a09bb45 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:14.854606 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a4dab0be-4b6e-4064-89d3-d9ab2a09bb45 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:14.856437 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-0f6639f5-cd1c-4f83-972d-f8017fcec193 req-bc80dbca-f773-46ac-b58d-708ea3a21265 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:14.856879 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-0f6639f5-cd1c-4f83-972d-f8017fcec193 req-bc80dbca-f773-46ac-b58d-708ea3a21265 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:14.868914 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-0f6639f5-cd1c-4f83-972d-f8017fcec193 req-bc80dbca-f773-46ac-b58d-708ea3a21265 service nova] Creating event network-changed:a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 for instance 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b on hv-cinder-81618 Nov 08 16:20:14.874954 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-0f6639f5-cd1c-4f83-972d-f8017fcec193 req-bc80dbca-f773-46ac-b58d-708ea3a21265 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037763 Nov 08 16:20:14.875778 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 623/1236] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:20:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:20:14.921235 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a4dab0be-4b6e-4064-89d3-d9ab2a09bb45 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 14 microversion: 2.1 time: 0.087389 Nov 08 16:20:14.922256 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 614/1237] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:14 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:20:14.935131 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-45dc8c9b-61ec-4972-840c-f9df5c4fa1db tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:14.936116 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-45dc8c9b-61ec-4972-840c-f9df5c4fa1db tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:14.942075 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-45dc8c9b-61ec-4972-840c-f9df5c4fa1db tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:14.942518 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-45dc8c9b-61ec-4972-840c-f9df5c4fa1db tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:14.943286 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-45dc8c9b-61ec-4972-840c-f9df5c4fa1db tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:14.943716 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-45dc8c9b-61ec-4972-840c-f9df5c4fa1db tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:15.004559 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-45dc8c9b-61ec-4972-840c-f9df5c4fa1db tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28220 microversion: 2.20 time: 0.073692 Nov 08 16:20:15.005500 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 624/1238] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:14 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28220 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:15.933126 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0fb78730-b2ba-4cad-82a0-775a4a894df1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:15.934154 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0fb78730-b2ba-4cad-82a0-775a4a894df1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:15.941046 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0fb78730-b2ba-4cad-82a0-775a4a894df1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:15.941487 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0fb78730-b2ba-4cad-82a0-775a4a894df1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:15.942282 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0fb78730-b2ba-4cad-82a0-775a4a894df1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:15.942707 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0fb78730-b2ba-4cad-82a0-775a4a894df1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:15.999724 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0fb78730-b2ba-4cad-82a0-775a4a894df1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 14 microversion: 2.1 time: 0.071073 Nov 08 16:20:16.000315 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 615/1239] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:15 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:20:16.016699 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-8417e50c-8f5e-4c73-9784-32177849e27e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:16.017697 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-8417e50c-8f5e-4c73-9784-32177849e27e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:16.025110 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8417e50c-8f5e-4c73-9784-32177849e27e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:16.025603 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8417e50c-8f5e-4c73-9784-32177849e27e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:16.026394 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8417e50c-8f5e-4c73-9784-32177849e27e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:16.026835 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8417e50c-8f5e-4c73-9784-32177849e27e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:16.089377 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-8417e50c-8f5e-4c73-9784-32177849e27e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28220 microversion: 2.20 time: 0.076540 Nov 08 16:20:16.090056 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 625/1240] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:16 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28220 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:17.011114 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3224e8f3-f227-4e5e-85ad-088f0f52044f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:17.012101 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3224e8f3-f227-4e5e-85ad-088f0f52044f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:17.018871 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3224e8f3-f227-4e5e-85ad-088f0f52044f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:17.019309 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3224e8f3-f227-4e5e-85ad-088f0f52044f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:17.020095 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3224e8f3-f227-4e5e-85ad-088f0f52044f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:17.020517 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3224e8f3-f227-4e5e-85ad-088f0f52044f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:17.087241 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3224e8f3-f227-4e5e-85ad-088f0f52044f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 14 microversion: 2.1 time: 0.080036 Nov 08 16:20:17.087850 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 616/1241] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:17 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:20:17.101590 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0f01da47-09fc-4dee-9f95-119711ae900c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:17.102618 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0f01da47-09fc-4dee-9f95-119711ae900c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:17.109535 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0f01da47-09fc-4dee-9f95-119711ae900c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:17.110028 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0f01da47-09fc-4dee-9f95-119711ae900c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:17.110806 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0f01da47-09fc-4dee-9f95-119711ae900c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:17.111241 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0f01da47-09fc-4dee-9f95-119711ae900c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:17.175708 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0f01da47-09fc-4dee-9f95-119711ae900c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28220 microversion: 2.20 time: 0.078624 Nov 08 16:20:17.176322 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 626/1242] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:17 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:18.098138 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a123f486-5cfd-4ab8-8622-82875aa56d5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:18.099157 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a123f486-5cfd-4ab8-8622-82875aa56d5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:18.105956 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a123f486-5cfd-4ab8-8622-82875aa56d5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:18.106396 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a123f486-5cfd-4ab8-8622-82875aa56d5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:18.107179 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a123f486-5cfd-4ab8-8622-82875aa56d5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:18.107582 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a123f486-5cfd-4ab8-8622-82875aa56d5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:18.166906 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a123f486-5cfd-4ab8-8622-82875aa56d5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 14 microversion: 2.1 time: 0.072683 Nov 08 16:20:18.167512 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 617/1243] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:18 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:20:18.187547 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-138e21f8-846f-4b44-9013-733d77e3e27e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:18.188546 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-138e21f8-846f-4b44-9013-733d77e3e27e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:18.195939 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-138e21f8-846f-4b44-9013-733d77e3e27e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:18.196387 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-138e21f8-846f-4b44-9013-733d77e3e27e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:18.197156 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-138e21f8-846f-4b44-9013-733d77e3e27e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:18.197592 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-138e21f8-846f-4b44-9013-733d77e3e27e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:18.263651 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-138e21f8-846f-4b44-9013-733d77e3e27e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28220 microversion: 2.20 time: 0.079987 Nov 08 16:20:18.264421 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 627/1244] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:18 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:19.179763 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b5c9898e-a3f1-4cd1-a737-42e776927a7b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:19.180722 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b5c9898e-a3f1-4cd1-a737-42e776927a7b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:19.187557 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b5c9898e-a3f1-4cd1-a737-42e776927a7b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:19.187995 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b5c9898e-a3f1-4cd1-a737-42e776927a7b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:19.188761 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b5c9898e-a3f1-4cd1-a737-42e776927a7b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:19.189189 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b5c9898e-a3f1-4cd1-a737-42e776927a7b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:19.254099 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b5c9898e-a3f1-4cd1-a737-42e776927a7b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 14 microversion: 2.1 time: 0.078735 Nov 08 16:20:19.257767 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 618/1245] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:19 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 08 16:20:19.275896 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0a36a953-2832-4775-a719-52012ebcc09d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:19.277011 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0a36a953-2832-4775-a719-52012ebcc09d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:19.283754 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0a36a953-2832-4775-a719-52012ebcc09d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:19.284404 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0a36a953-2832-4775-a719-52012ebcc09d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:19.285175 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0a36a953-2832-4775-a719-52012ebcc09d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:19.285610 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0a36a953-2832-4775-a719-52012ebcc09d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:19.371794 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0a36a953-2832-4775-a719-52012ebcc09d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28511 microversion: 2.20 time: 0.099862 Nov 08 16:20:19.373767 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 628/1246] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:19 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28511 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:20.264980 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-787029d2-92f4-46da-a264-4c73dda4a54e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:20.266050 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-787029d2-92f4-46da-a264-4c73dda4a54e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:20.272791 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-787029d2-92f4-46da-a264-4c73dda4a54e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:20.273229 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-787029d2-92f4-46da-a264-4c73dda4a54e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:20.274013 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-787029d2-92f4-46da-a264-4c73dda4a54e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:20.274438 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-787029d2-92f4-46da-a264-4c73dda4a54e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:20.340031 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-787029d2-92f4-46da-a264-4c73dda4a54e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 14 microversion: 2.1 time: 0.078893 Nov 08 16:20:20.340560 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 619/1247] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:20 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:20:20.384271 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-146cd584-04fd-4ae1-b610-e3e62cbe4d8b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:20.385263 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-146cd584-04fd-4ae1-b610-e3e62cbe4d8b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:20.392046 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-146cd584-04fd-4ae1-b610-e3e62cbe4d8b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:20.392482 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-146cd584-04fd-4ae1-b610-e3e62cbe4d8b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:20.393241 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-146cd584-04fd-4ae1-b610-e3e62cbe4d8b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:20.393667 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-146cd584-04fd-4ae1-b610-e3e62cbe4d8b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:20.496673 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-146cd584-04fd-4ae1-b610-e3e62cbe4d8b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28677 microversion: 2.20 time: 0.116901 Nov 08 16:20:20.497333 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 629/1248] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:20 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28677 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:21.351969 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-223f4a3f-6cce-47fd-8af3-e3fe305221ad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:21.352899 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-223f4a3f-6cce-47fd-8af3-e3fe305221ad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:21.359946 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-223f4a3f-6cce-47fd-8af3-e3fe305221ad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:21.360421 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-223f4a3f-6cce-47fd-8af3-e3fe305221ad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:21.361282 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-223f4a3f-6cce-47fd-8af3-e3fe305221ad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:21.361732 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-223f4a3f-6cce-47fd-8af3-e3fe305221ad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:21.421286 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-223f4a3f-6cce-47fd-8af3-e3fe305221ad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 14 microversion: 2.1 time: 0.073882 Nov 08 16:20:21.421929 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 620/1249] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:21 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:20:21.508643 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-080bf538-fd8b-4149-a802-d48669d92bd6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:21.509630 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-080bf538-fd8b-4149-a802-d48669d92bd6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:21.516381 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-080bf538-fd8b-4149-a802-d48669d92bd6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:21.516822 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-080bf538-fd8b-4149-a802-d48669d92bd6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:21.517582 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-080bf538-fd8b-4149-a802-d48669d92bd6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:21.518034 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-080bf538-fd8b-4149-a802-d48669d92bd6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:21.625264 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-080bf538-fd8b-4149-a802-d48669d92bd6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.120511 Nov 08 16:20:21.625834 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 630/1250] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:21 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:22.432822 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3b182195-617c-4daf-96af-b942a1cc5d20 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:22.433763 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3b182195-617c-4daf-96af-b942a1cc5d20 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:22.440641 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3b182195-617c-4daf-96af-b942a1cc5d20 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:22.441111 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3b182195-617c-4daf-96af-b942a1cc5d20 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:22.441919 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3b182195-617c-4daf-96af-b942a1cc5d20 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:22.442351 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3b182195-617c-4daf-96af-b942a1cc5d20 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:22.512271 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3b182195-617c-4daf-96af-b942a1cc5d20 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 14 microversion: 2.1 time: 0.083514 Nov 08 16:20:22.512863 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 621/1251] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:22 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:20:22.637534 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-de83f1aa-54bc-49b4-8b4a-c6ceb626109c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:22.638549 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-de83f1aa-54bc-49b4-8b4a-c6ceb626109c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:22.645250 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-de83f1aa-54bc-49b4-8b4a-c6ceb626109c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:22.645691 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-de83f1aa-54bc-49b4-8b4a-c6ceb626109c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:22.646467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-de83f1aa-54bc-49b4-8b4a-c6ceb626109c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:22.646895 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-de83f1aa-54bc-49b4-8b4a-c6ceb626109c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:22.720540 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-de83f1aa-54bc-49b4-8b4a-c6ceb626109c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.086792 Nov 08 16:20:22.721098 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 631/1252] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:22 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:23.524186 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3beb3853-d4d0-4a3f-994b-942e495c9793 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:23.525213 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3beb3853-d4d0-4a3f-994b-942e495c9793 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:23.531956 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3beb3853-d4d0-4a3f-994b-942e495c9793 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:23.532398 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3beb3853-d4d0-4a3f-994b-942e495c9793 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:23.533167 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3beb3853-d4d0-4a3f-994b-942e495c9793 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:23.533592 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3beb3853-d4d0-4a3f-994b-942e495c9793 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:23.598352 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3beb3853-d4d0-4a3f-994b-942e495c9793 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 14 microversion: 2.1 time: 0.078629 Nov 08 16:20:23.598980 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 622/1253] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:23 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:20:23.732953 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-10fa65f2-b004-43c9-bca2-d70970fb8b45 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:23.733982 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-10fa65f2-b004-43c9-bca2-d70970fb8b45 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:23.740737 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-10fa65f2-b004-43c9-bca2-d70970fb8b45 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:23.741181 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-10fa65f2-b004-43c9-bca2-d70970fb8b45 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:23.742042 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-10fa65f2-b004-43c9-bca2-d70970fb8b45 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:23.742467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-10fa65f2-b004-43c9-bca2-d70970fb8b45 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:23.806900 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-10fa65f2-b004-43c9-bca2-d70970fb8b45 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.077856 Nov 08 16:20:23.807459 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 632/1254] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:23 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:24.610723 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ad4fcd31-d0fb-4adc-b3c9-3067d45b42a1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:24.611732 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ad4fcd31-d0fb-4adc-b3c9-3067d45b42a1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:24.619283 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ad4fcd31-d0fb-4adc-b3c9-3067d45b42a1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:24.619720 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ad4fcd31-d0fb-4adc-b3c9-3067d45b42a1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:24.620473 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ad4fcd31-d0fb-4adc-b3c9-3067d45b42a1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:24.620891 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ad4fcd31-d0fb-4adc-b3c9-3067d45b42a1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:24.679938 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ad4fcd31-d0fb-4adc-b3c9-3067d45b42a1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 14 microversion: 2.1 time: 0.073100 Nov 08 16:20:24.680719 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 623/1255] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:24 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:20:24.818946 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ded246cd-8495-463f-a53b-55cea67c37fe tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:24.819946 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ded246cd-8495-463f-a53b-55cea67c37fe tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:24.826938 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ded246cd-8495-463f-a53b-55cea67c37fe tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:24.827390 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ded246cd-8495-463f-a53b-55cea67c37fe tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:24.828171 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ded246cd-8495-463f-a53b-55cea67c37fe tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:24.828608 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ded246cd-8495-463f-a53b-55cea67c37fe tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:24.902633 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ded246cd-8495-463f-a53b-55cea67c37fe tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.087628 Nov 08 16:20:24.903301 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 633/1256] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:24 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:25.691308 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5eb433fa-1f32-42db-9b5c-9c262478cc9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:25.692339 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5eb433fa-1f32-42db-9b5c-9c262478cc9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:25.699155 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5eb433fa-1f32-42db-9b5c-9c262478cc9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:25.699602 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5eb433fa-1f32-42db-9b5c-9c262478cc9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:25.700375 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5eb433fa-1f32-42db-9b5c-9c262478cc9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:25.700804 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5eb433fa-1f32-42db-9b5c-9c262478cc9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:25.770345 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5eb433fa-1f32-42db-9b5c-9c262478cc9f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 10009 microversion: 2.1 time: 0.082815 Nov 08 16:20:25.770986 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 624/1257] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:25 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 10009 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:25.915472 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1ae0357b-d7ab-44bc-912c-c567153c11ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:25.916506 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1ae0357b-d7ab-44bc-912c-c567153c11ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:25.923341 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1ae0357b-d7ab-44bc-912c-c567153c11ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:25.923786 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1ae0357b-d7ab-44bc-912c-c567153c11ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:25.924553 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1ae0357b-d7ab-44bc-912c-c567153c11ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:25.924986 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1ae0357b-d7ab-44bc-912c-c567153c11ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:26.001334 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1ae0357b-d7ab-44bc-912c-c567153c11ee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.090371 Nov 08 16:20:26.001966 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 634/1258] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:25 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:26.782389 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0b8808f7-5f49-4418-aa5f-b8afaf813340 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:26.783381 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0b8808f7-5f49-4418-aa5f-b8afaf813340 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:26.790730 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0b8808f7-5f49-4418-aa5f-b8afaf813340 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:26.791167 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0b8808f7-5f49-4418-aa5f-b8afaf813340 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:26.791922 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0b8808f7-5f49-4418-aa5f-b8afaf813340 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:26.792344 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0b8808f7-5f49-4418-aa5f-b8afaf813340 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:26.864001 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0b8808f7-5f49-4418-aa5f-b8afaf813340 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 16710 microversion: 2.1 time: 0.085473 Nov 08 16:20:26.864862 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 625/1259] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:26 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 16710 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:27.013738 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ad073828-4e76-49b3-94bf-931a2326ece7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:27.014767 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ad073828-4e76-49b3-94bf-931a2326ece7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:27.021042 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad073828-4e76-49b3-94bf-931a2326ece7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:27.021482 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad073828-4e76-49b3-94bf-931a2326ece7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:27.022848 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad073828-4e76-49b3-94bf-931a2326ece7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:27.023283 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad073828-4e76-49b3-94bf-931a2326ece7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:27.092073 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ad073828-4e76-49b3-94bf-931a2326ece7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.082598 Nov 08 16:20:27.092718 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 635/1260] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:27 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:27.876104 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b4510be6-522e-4ccd-b703-a77942976218 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:27.877024 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b4510be6-522e-4ccd-b703-a77942976218 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:27.883991 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b4510be6-522e-4ccd-b703-a77942976218 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:27.884435 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b4510be6-522e-4ccd-b703-a77942976218 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:27.885199 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b4510be6-522e-4ccd-b703-a77942976218 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:27.885627 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b4510be6-522e-4ccd-b703-a77942976218 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:27.967566 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b4510be6-522e-4ccd-b703-a77942976218 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 18356 microversion: 2.1 time: 0.095551 Nov 08 16:20:27.968197 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 626/1261] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:27 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 18356 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:28.103814 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7369ae67-ef39-4c6a-9ee1-cd24f2ed7489 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:28.104799 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7369ae67-ef39-4c6a-9ee1-cd24f2ed7489 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:28.111394 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7369ae67-ef39-4c6a-9ee1-cd24f2ed7489 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:28.111835 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7369ae67-ef39-4c6a-9ee1-cd24f2ed7489 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:28.112607 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7369ae67-ef39-4c6a-9ee1-cd24f2ed7489 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:28.113033 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7369ae67-ef39-4c6a-9ee1-cd24f2ed7489 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:28.177843 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7369ae67-ef39-4c6a-9ee1-cd24f2ed7489 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.078478 Nov 08 16:20:28.178513 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 636/1262] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:28 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:28.979993 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b82bea1f-bf2c-48b6-b0cd-541ab2dde55f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:28.981018 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b82bea1f-bf2c-48b6-b0cd-541ab2dde55f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:28.987812 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b82bea1f-bf2c-48b6-b0cd-541ab2dde55f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:28.988251 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b82bea1f-bf2c-48b6-b0cd-541ab2dde55f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:28.989015 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b82bea1f-bf2c-48b6-b0cd-541ab2dde55f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:28.989442 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b82bea1f-bf2c-48b6-b0cd-541ab2dde55f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:29.073263 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b82bea1f-bf2c-48b6-b0cd-541ab2dde55f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 20751 microversion: 2.1 time: 0.097681 Nov 08 16:20:29.073910 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 627/1263] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:28 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 20751 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:29.189389 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-789a6183-8243-45b0-b4dc-33da142c0786 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:29.190418 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-789a6183-8243-45b0-b4dc-33da142c0786 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:29.197752 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-789a6183-8243-45b0-b4dc-33da142c0786 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:29.198207 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-789a6183-8243-45b0-b4dc-33da142c0786 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:29.198975 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-789a6183-8243-45b0-b4dc-33da142c0786 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:29.199408 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-789a6183-8243-45b0-b4dc-33da142c0786 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:29.268814 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-789a6183-8243-45b0-b4dc-33da142c0786 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.083380 Nov 08 16:20:29.269436 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 637/1264] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:29 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:30.085419 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5c2abbe2-d036-4bd3-ae11-33b4d46633a2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:30.086431 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5c2abbe2-d036-4bd3-ae11-33b4d46633a2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:30.093184 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5c2abbe2-d036-4bd3-ae11-33b4d46633a2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:30.093621 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5c2abbe2-d036-4bd3-ae11-33b4d46633a2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:30.094408 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5c2abbe2-d036-4bd3-ae11-33b4d46633a2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:30.094832 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5c2abbe2-d036-4bd3-ae11-33b4d46633a2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:30.170839 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5c2abbe2-d036-4bd3-ae11-33b4d46633a2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 22799 microversion: 2.1 time: 0.089912 Nov 08 16:20:30.171442 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 628/1265] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:30 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 22799 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:30.280938 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f5d8dc6a-d964-4011-94cc-e3af22a24511 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:30.281952 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f5d8dc6a-d964-4011-94cc-e3af22a24511 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:30.288716 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f5d8dc6a-d964-4011-94cc-e3af22a24511 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:30.289154 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f5d8dc6a-d964-4011-94cc-e3af22a24511 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:30.289941 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f5d8dc6a-d964-4011-94cc-e3af22a24511 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:30.290370 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f5d8dc6a-d964-4011-94cc-e3af22a24511 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:30.354729 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f5d8dc6a-d964-4011-94cc-e3af22a24511 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.077680 Nov 08 16:20:30.355290 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 638/1266] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:30 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:31.183268 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-caaa1485-d027-4c73-b675-d7442bc63b7d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:31.184184 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-caaa1485-d027-4c73-b675-d7442bc63b7d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:31.191042 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-caaa1485-d027-4c73-b675-d7442bc63b7d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:31.191599 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-caaa1485-d027-4c73-b675-d7442bc63b7d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:31.192266 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-caaa1485-d027-4c73-b675-d7442bc63b7d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:31.192693 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-caaa1485-d027-4c73-b675-d7442bc63b7d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:31.265432 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-caaa1485-d027-4c73-b675-d7442bc63b7d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 23794 microversion: 2.1 time: 0.086187 Nov 08 16:20:31.266065 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 629/1267] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:31 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 23794 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:31.366684 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b2cd3f89-5a43-43d1-b817-26b77f1bc70a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:31.367947 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b2cd3f89-5a43-43d1-b817-26b77f1bc70a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:31.374853 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b2cd3f89-5a43-43d1-b817-26b77f1bc70a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:31.375302 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b2cd3f89-5a43-43d1-b817-26b77f1bc70a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:31.376071 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b2cd3f89-5a43-43d1-b817-26b77f1bc70a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:31.376507 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b2cd3f89-5a43-43d1-b817-26b77f1bc70a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:31.447474 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b2cd3f89-5a43-43d1-b817-26b77f1bc70a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.084526 Nov 08 16:20:31.448252 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 639/1268] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:31 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:32.277729 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-731acb07-9acc-4a9b-9b41-56f756325889 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:32.278771 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-731acb07-9acc-4a9b-9b41-56f756325889 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:32.285552 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-731acb07-9acc-4a9b-9b41-56f756325889 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:32.286023 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-731acb07-9acc-4a9b-9b41-56f756325889 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:32.286799 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-731acb07-9acc-4a9b-9b41-56f756325889 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:32.287229 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-731acb07-9acc-4a9b-9b41-56f756325889 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:32.358946 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-731acb07-9acc-4a9b-9b41-56f756325889 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 25087 microversion: 2.1 time: 0.085122 Nov 08 16:20:32.359785 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 630/1269] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:32 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 25087 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:32.459995 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-de0d10ad-6bac-49ad-8f31-c6a0defaa258 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:32.460985 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-de0d10ad-6bac-49ad-8f31-c6a0defaa258 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:32.467775 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-de0d10ad-6bac-49ad-8f31-c6a0defaa258 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:32.468216 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-de0d10ad-6bac-49ad-8f31-c6a0defaa258 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:32.468978 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-de0d10ad-6bac-49ad-8f31-c6a0defaa258 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:32.469403 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-de0d10ad-6bac-49ad-8f31-c6a0defaa258 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:32.530419 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-de0d10ad-6bac-49ad-8f31-c6a0defaa258 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.074895 Nov 08 16:20:32.531048 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 640/1270] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:32 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:33.370780 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-82cfdb10-3add-45d8-a508-86fe7a2b1e0a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:33.372410 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-82cfdb10-3add-45d8-a508-86fe7a2b1e0a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:33.379414 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-82cfdb10-3add-45d8-a508-86fe7a2b1e0a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:33.379861 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-82cfdb10-3add-45d8-a508-86fe7a2b1e0a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:33.380633 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-82cfdb10-3add-45d8-a508-86fe7a2b1e0a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:33.381066 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-82cfdb10-3add-45d8-a508-86fe7a2b1e0a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:33.455863 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-82cfdb10-3add-45d8-a508-86fe7a2b1e0a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 26624 microversion: 2.1 time: 0.089323 Nov 08 16:20:33.456966 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 631/1271] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:33 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 26624 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:33.542205 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-fa2c1b9f-1c3a-4a45-8c5c-6795b2d45ee3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:33.543252 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-fa2c1b9f-1c3a-4a45-8c5c-6795b2d45ee3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:33.550347 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fa2c1b9f-1c3a-4a45-8c5c-6795b2d45ee3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:33.550672 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fa2c1b9f-1c3a-4a45-8c5c-6795b2d45ee3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:33.551444 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fa2c1b9f-1c3a-4a45-8c5c-6795b2d45ee3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:33.551878 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fa2c1b9f-1c3a-4a45-8c5c-6795b2d45ee3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:33.617055 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-fa2c1b9f-1c3a-4a45-8c5c-6795b2d45ee3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.079338 Nov 08 16:20:33.617991 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 641/1272] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:33 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:34.468592 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-32a2041c-c4b6-456a-a939-5a5bf7e7ca5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:34.469591 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-32a2041c-c4b6-456a-a939-5a5bf7e7ca5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:34.476910 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-32a2041c-c4b6-456a-a939-5a5bf7e7ca5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:34.477350 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-32a2041c-c4b6-456a-a939-5a5bf7e7ca5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:34.478164 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-32a2041c-c4b6-456a-a939-5a5bf7e7ca5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:34.478590 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-32a2041c-c4b6-456a-a939-5a5bf7e7ca5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:34.556496 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-32a2041c-c4b6-456a-a939-5a5bf7e7ca5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 27556 microversion: 2.1 time: 0.091857 Nov 08 16:20:34.557128 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 632/1273] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:34 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 27556 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:34.629266 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a6d75a77-b2c2-4679-8fd0-65cb05c24316 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:34.630292 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a6d75a77-b2c2-4679-8fd0-65cb05c24316 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:34.637604 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a6d75a77-b2c2-4679-8fd0-65cb05c24316 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:34.638079 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a6d75a77-b2c2-4679-8fd0-65cb05c24316 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:34.638849 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a6d75a77-b2c2-4679-8fd0-65cb05c24316 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:34.639286 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a6d75a77-b2c2-4679-8fd0-65cb05c24316 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:34.702911 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a6d75a77-b2c2-4679-8fd0-65cb05c24316 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.077680 Nov 08 16:20:34.703529 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 642/1274] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:34 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:35.568407 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a5100d1d-39ed-4d95-844f-e0a6008c9c8a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:35.570004 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a5100d1d-39ed-4d95-844f-e0a6008c9c8a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:35.576750 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a5100d1d-39ed-4d95-844f-e0a6008c9c8a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:35.577183 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a5100d1d-39ed-4d95-844f-e0a6008c9c8a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:35.577980 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a5100d1d-39ed-4d95-844f-e0a6008c9c8a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:35.578409 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a5100d1d-39ed-4d95-844f-e0a6008c9c8a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:35.658009 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a5100d1d-39ed-4d95-844f-e0a6008c9c8a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 27905 microversion: 2.1 time: 0.093447 Nov 08 16:20:35.658618 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 633/1275] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:35 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 27905 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:35.714775 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ad6d9a7e-df8b-4bcb-b016-8ba8ef873a6b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:35.715800 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ad6d9a7e-df8b-4bcb-b016-8ba8ef873a6b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:35.722603 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad6d9a7e-df8b-4bcb-b016-8ba8ef873a6b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:35.723052 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad6d9a7e-df8b-4bcb-b016-8ba8ef873a6b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:35.723817 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad6d9a7e-df8b-4bcb-b016-8ba8ef873a6b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:35.724256 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ad6d9a7e-df8b-4bcb-b016-8ba8ef873a6b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:35.787916 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ad6d9a7e-df8b-4bcb-b016-8ba8ef873a6b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.076987 Nov 08 16:20:35.788801 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 643/1276] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:35 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:36.670109 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c5bfc3f3-2d8c-43b1-a066-dbdf4c253561 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:36.671126 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c5bfc3f3-2d8c-43b1-a066-dbdf4c253561 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:36.678854 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c5bfc3f3-2d8c-43b1-a066-dbdf4c253561 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:36.679303 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c5bfc3f3-2d8c-43b1-a066-dbdf4c253561 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:36.680071 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c5bfc3f3-2d8c-43b1-a066-dbdf4c253561 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:36.680498 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c5bfc3f3-2d8c-43b1-a066-dbdf4c253561 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:36.770163 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c5bfc3f3-2d8c-43b1-a066-dbdf4c253561 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28201 microversion: 2.1 time: 0.103958 Nov 08 16:20:36.770917 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 634/1277] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:36 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28201 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:36.800142 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-053ca59e-40b3-430e-bec0-0e675799c520 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:36.801157 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-053ca59e-40b3-430e-bec0-0e675799c520 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:36.808497 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-053ca59e-40b3-430e-bec0-0e675799c520 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:36.808934 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-053ca59e-40b3-430e-bec0-0e675799c520 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:36.809691 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-053ca59e-40b3-430e-bec0-0e675799c520 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:36.810144 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-053ca59e-40b3-430e-bec0-0e675799c520 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:36.879740 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-053ca59e-40b3-430e-bec0-0e675799c520 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.083535 Nov 08 16:20:36.880345 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 644/1278] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:36 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:37.781828 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a0b5a266-c62a-4e53-a799-20ebd44b6ce0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:37.782807 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a0b5a266-c62a-4e53-a799-20ebd44b6ce0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:37.790148 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a0b5a266-c62a-4e53-a799-20ebd44b6ce0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:37.790588 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a0b5a266-c62a-4e53-a799-20ebd44b6ce0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:37.791350 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a0b5a266-c62a-4e53-a799-20ebd44b6ce0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:37.791768 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a0b5a266-c62a-4e53-a799-20ebd44b6ce0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:37.851328 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a0b5a266-c62a-4e53-a799-20ebd44b6ce0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28201 microversion: 2.1 time: 0.073354 Nov 08 16:20:37.851868 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 635/1279] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:37 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28201 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:37.891626 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7d510b58-5964-4978-8137-eb43fc98242f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:37.892657 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7d510b58-5964-4978-8137-eb43fc98242f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:37.899942 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7d510b58-5964-4978-8137-eb43fc98242f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:37.900390 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7d510b58-5964-4978-8137-eb43fc98242f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:37.901157 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7d510b58-5964-4978-8137-eb43fc98242f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:37.901595 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7d510b58-5964-4978-8137-eb43fc98242f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:37.965791 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7d510b58-5964-4978-8137-eb43fc98242f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.078124 Nov 08 16:20:37.966407 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 645/1280] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:37 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:38.863660 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-961d41af-8811-4a7e-b4fa-4c2ee7c58472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:38.864787 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-961d41af-8811-4a7e-b4fa-4c2ee7c58472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:38.872497 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-961d41af-8811-4a7e-b4fa-4c2ee7c58472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:38.872937 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-961d41af-8811-4a7e-b4fa-4c2ee7c58472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:38.873732 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-961d41af-8811-4a7e-b4fa-4c2ee7c58472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:38.874156 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-961d41af-8811-4a7e-b4fa-4c2ee7c58472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:38.949330 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-961d41af-8811-4a7e-b4fa-4c2ee7c58472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28201 microversion: 2.1 time: 0.090077 Nov 08 16:20:38.950224 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 636/1281] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:38 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:38.977623 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-fd8beaea-097d-41ce-bf01-2cf17e0e7a57 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:38.978655 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-fd8beaea-097d-41ce-bf01-2cf17e0e7a57 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:38.985418 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fd8beaea-097d-41ce-bf01-2cf17e0e7a57 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:38.985895 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fd8beaea-097d-41ce-bf01-2cf17e0e7a57 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:38.986657 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fd8beaea-097d-41ce-bf01-2cf17e0e7a57 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:38.987082 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fd8beaea-097d-41ce-bf01-2cf17e0e7a57 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:39.047203 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-fd8beaea-097d-41ce-bf01-2cf17e0e7a57 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.073499 Nov 08 16:20:39.048104 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 646/1282] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:38 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:39.961755 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1c97c801-b98f-4356-bcfb-706eb3126f9b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:39.962662 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1c97c801-b98f-4356-bcfb-706eb3126f9b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:39.969477 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1c97c801-b98f-4356-bcfb-706eb3126f9b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:39.969952 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1c97c801-b98f-4356-bcfb-706eb3126f9b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:39.970721 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1c97c801-b98f-4356-bcfb-706eb3126f9b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:39.971151 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1c97c801-b98f-4356-bcfb-706eb3126f9b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:40.034244 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1c97c801-b98f-4356-bcfb-706eb3126f9b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28201 microversion: 2.1 time: 0.077193 Nov 08 16:20:40.034894 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 637/1283] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:39 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28201 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:40.059656 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2654ca65-1e6c-4d8b-9a6b-3336ee08223e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:40.060658 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2654ca65-1e6c-4d8b-9a6b-3336ee08223e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:40.067578 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2654ca65-1e6c-4d8b-9a6b-3336ee08223e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:40.068028 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2654ca65-1e6c-4d8b-9a6b-3336ee08223e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:40.069410 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2654ca65-1e6c-4d8b-9a6b-3336ee08223e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:40.069890 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2654ca65-1e6c-4d8b-9a6b-3336ee08223e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:40.136851 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2654ca65-1e6c-4d8b-9a6b-3336ee08223e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.081125 Nov 08 16:20:40.137480 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 647/1284] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:40 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:41.045337 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0f40d915-ff82-4abf-a200-1d1d462d09df tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:41.046355 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0f40d915-ff82-4abf-a200-1d1d462d09df tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:41.053594 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0f40d915-ff82-4abf-a200-1d1d462d09df tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:41.054056 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0f40d915-ff82-4abf-a200-1d1d462d09df tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:41.054819 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0f40d915-ff82-4abf-a200-1d1d462d09df tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:41.055243 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0f40d915-ff82-4abf-a200-1d1d462d09df tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:41.125385 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0f40d915-ff82-4abf-a200-1d1d462d09df tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28201 microversion: 2.1 time: 0.083902 Nov 08 16:20:41.126299 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 638/1285] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:41 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28201 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:41.148780 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-425f10a8-f99e-4418-af98-a5899d86d066 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:41.149790 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-425f10a8-f99e-4418-af98-a5899d86d066 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:41.156561 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-425f10a8-f99e-4418-af98-a5899d86d066 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:41.157004 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-425f10a8-f99e-4418-af98-a5899d86d066 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:41.157785 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-425f10a8-f99e-4418-af98-a5899d86d066 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:41.158215 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-425f10a8-f99e-4418-af98-a5899d86d066 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:41.217442 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-425f10a8-f99e-4418-af98-a5899d86d066 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.072741 Nov 08 16:20:41.218105 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 648/1286] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:41 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:42.137888 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-719ea487-12d4-44b0-8a0b-949b4604e11a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:42.138899 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-719ea487-12d4-44b0-8a0b-949b4604e11a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:42.145573 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-719ea487-12d4-44b0-8a0b-949b4604e11a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:42.146039 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-719ea487-12d4-44b0-8a0b-949b4604e11a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:42.147327 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-719ea487-12d4-44b0-8a0b-949b4604e11a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:42.147747 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-719ea487-12d4-44b0-8a0b-949b4604e11a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:42.210257 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-719ea487-12d4-44b0-8a0b-949b4604e11a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28201 microversion: 2.1 time: 0.076228 Nov 08 16:20:42.211115 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 639/1287] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:42 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28201 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:42.228828 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-884fb1e1-8f8d-45aa-a642-69ca332146ef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:42.229852 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-884fb1e1-8f8d-45aa-a642-69ca332146ef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:42.236576 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-884fb1e1-8f8d-45aa-a642-69ca332146ef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:42.237021 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-884fb1e1-8f8d-45aa-a642-69ca332146ef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:42.237847 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-884fb1e1-8f8d-45aa-a642-69ca332146ef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:42.238276 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-884fb1e1-8f8d-45aa-a642-69ca332146ef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:42.300713 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-884fb1e1-8f8d-45aa-a642-69ca332146ef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.075888 Nov 08 16:20:42.301338 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 649/1288] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:42 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:43.222638 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-2dc334a4-8f69-4c25-986a-7a64f37dc2d0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:43.223637 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-2dc334a4-8f69-4c25-986a-7a64f37dc2d0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:43.230553 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2dc334a4-8f69-4c25-986a-7a64f37dc2d0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:43.230999 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2dc334a4-8f69-4c25-986a-7a64f37dc2d0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:43.231774 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2dc334a4-8f69-4c25-986a-7a64f37dc2d0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:43.232206 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2dc334a4-8f69-4c25-986a-7a64f37dc2d0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:43.298363 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-2dc334a4-8f69-4c25-986a-7a64f37dc2d0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28201 microversion: 2.1 time: 0.079565 Nov 08 16:20:43.299011 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 640/1289] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:43 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28201 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:43.312819 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-17946285-4439-469f-bffd-75e9f0d9d875 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:43.313877 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-17946285-4439-469f-bffd-75e9f0d9d875 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:43.321205 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-17946285-4439-469f-bffd-75e9f0d9d875 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:43.321653 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-17946285-4439-469f-bffd-75e9f0d9d875 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:43.322444 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-17946285-4439-469f-bffd-75e9f0d9d875 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:43.322885 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-17946285-4439-469f-bffd-75e9f0d9d875 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:43.387942 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-17946285-4439-469f-bffd-75e9f0d9d875 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.078928 Nov 08 16:20:43.388493 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 650/1290] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:43 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:20:44.310416 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-597560da-43a7-451a-ab4d-d19745eb01a3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:44.311412 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-597560da-43a7-451a-ab4d-d19745eb01a3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:44.318773 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-597560da-43a7-451a-ab4d-d19745eb01a3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:44.319216 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-597560da-43a7-451a-ab4d-d19745eb01a3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:44.319981 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-597560da-43a7-451a-ab4d-d19745eb01a3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:44.320409 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-597560da-43a7-451a-ab4d-d19745eb01a3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:44.394617 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-597560da-43a7-451a-ab4d-d19745eb01a3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28201 microversion: 2.1 time: 0.088190 Nov 08 16:20:44.395432 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 641/1291] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:44 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28201 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:44.400560 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f8e6999a-27a1-49e5-be94-a7954e318104 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:44.401545 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f8e6999a-27a1-49e5-be94-a7954e318104 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:44.408448 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8e6999a-27a1-49e5-be94-a7954e318104 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:44.408895 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8e6999a-27a1-49e5-be94-a7954e318104 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:44.409662 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8e6999a-27a1-49e5-be94-a7954e318104 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:44.410119 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f8e6999a-27a1-49e5-be94-a7954e318104 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:44.468226 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f8e6999a-27a1-49e5-be94-a7954e318104 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.072284 Nov 08 16:20:44.468836 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 651/1292] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:44 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:45.407184 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e09c88e1-0ad3-4ca5-ba27-775d1b840496 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:45.408087 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e09c88e1-0ad3-4ca5-ba27-775d1b840496 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:45.415569 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e09c88e1-0ad3-4ca5-ba27-775d1b840496 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:45.416008 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e09c88e1-0ad3-4ca5-ba27-775d1b840496 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:45.416773 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e09c88e1-0ad3-4ca5-ba27-775d1b840496 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:45.417200 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e09c88e1-0ad3-4ca5-ba27-775d1b840496 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:45.478468 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e09c88e1-0ad3-4ca5-ba27-775d1b840496 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28201 microversion: 2.1 time: 0.075273 Nov 08 16:20:45.482300 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 642/1293] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:45 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28201 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:45.482454 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-59533bdf-9400-4119-911e-d61fc1777370 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:45.482454 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-59533bdf-9400-4119-911e-d61fc1777370 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:45.488760 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-59533bdf-9400-4119-911e-d61fc1777370 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:45.489203 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-59533bdf-9400-4119-911e-d61fc1777370 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:45.490057 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-59533bdf-9400-4119-911e-d61fc1777370 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:45.490489 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-59533bdf-9400-4119-911e-d61fc1777370 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:45.559239 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-59533bdf-9400-4119-911e-d61fc1777370 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.082379 Nov 08 16:20:45.559852 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 652/1294] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:45 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:46.489684 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6a0d1ced-a043-4e73-af45-1588e1eccdb3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:46.490624 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6a0d1ced-a043-4e73-af45-1588e1eccdb3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:46.497793 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6a0d1ced-a043-4e73-af45-1588e1eccdb3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:46.498236 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6a0d1ced-a043-4e73-af45-1588e1eccdb3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:46.499002 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6a0d1ced-a043-4e73-af45-1588e1eccdb3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:46.499428 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6a0d1ced-a043-4e73-af45-1588e1eccdb3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:46.571686 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-885b7f16-4601-4fd7-9d59-133d7018c5c2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:46.572789 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-885b7f16-4601-4fd7-9d59-133d7018c5c2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:46.577063 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6a0d1ced-a043-4e73-af45-1588e1eccdb3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28201 microversion: 2.1 time: 0.091339 Nov 08 16:20:46.578646 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 643/1295] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:46 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28201 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:46.579745 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-885b7f16-4601-4fd7-9d59-133d7018c5c2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:46.580192 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-885b7f16-4601-4fd7-9d59-133d7018c5c2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:46.580973 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-885b7f16-4601-4fd7-9d59-133d7018c5c2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:46.581413 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-885b7f16-4601-4fd7-9d59-133d7018c5c2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:46.642147 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-885b7f16-4601-4fd7-9d59-133d7018c5c2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.074875 Nov 08 16:20:46.642998 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 653/1296] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:46 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:47.589368 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f30665d4-5394-49ae-984e-1354c93b51c2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:47.590424 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f30665d4-5394-49ae-984e-1354c93b51c2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:47.597297 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f30665d4-5394-49ae-984e-1354c93b51c2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:47.597753 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f30665d4-5394-49ae-984e-1354c93b51c2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:47.598526 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f30665d4-5394-49ae-984e-1354c93b51c2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:47.598952 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f30665d4-5394-49ae-984e-1354c93b51c2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:47.654418 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-baf0a0db-9d4a-41b3-a6db-954243ab203e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:47.655413 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-baf0a0db-9d4a-41b3-a6db-954243ab203e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:47.662634 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f30665d4-5394-49ae-984e-1354c93b51c2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28201 microversion: 2.1 time: 0.076524 Nov 08 16:20:47.662966 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-baf0a0db-9d4a-41b3-a6db-954243ab203e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:47.663510 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 644/1297] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:47 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28201 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:20:47.663647 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-baf0a0db-9d4a-41b3-a6db-954243ab203e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:47.664258 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-baf0a0db-9d4a-41b3-a6db-954243ab203e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:47.664690 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-baf0a0db-9d4a-41b3-a6db-954243ab203e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:47.731194 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-baf0a0db-9d4a-41b3-a6db-954243ab203e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.080645 Nov 08 16:20:47.732501 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 654/1298] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:47 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:48.674794 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f78f607e-f379-474d-b214-7416a7d1b9ae tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:48.675780 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f78f607e-f379-474d-b214-7416a7d1b9ae tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:48.683125 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f78f607e-f379-474d-b214-7416a7d1b9ae tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:48.683568 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f78f607e-f379-474d-b214-7416a7d1b9ae tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:48.684331 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f78f607e-f379-474d-b214-7416a7d1b9ae tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:48.684762 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f78f607e-f379-474d-b214-7416a7d1b9ae tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:48.744784 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-01dcbf70-96ec-4d6e-9e4f-b120974c4049 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:48.746020 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-01dcbf70-96ec-4d6e-9e4f-b120974c4049 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:48.747723 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f78f607e-f379-474d-b214-7416a7d1b9ae tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28201 microversion: 2.1 time: 0.076788 Nov 08 16:20:48.748570 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 645/1299] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:48 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28201 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:48.752921 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-01dcbf70-96ec-4d6e-9e4f-b120974c4049 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:48.753381 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-01dcbf70-96ec-4d6e-9e4f-b120974c4049 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:48.754205 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-01dcbf70-96ec-4d6e-9e4f-b120974c4049 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:48.754643 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-01dcbf70-96ec-4d6e-9e4f-b120974c4049 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:48.822640 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-01dcbf70-96ec-4d6e-9e4f-b120974c4049 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.083150 Nov 08 16:20:48.823543 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 655/1300] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:48 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:49.759719 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d7161446-8863-4d58-ad00-519bf5897514 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:49.760723 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d7161446-8863-4d58-ad00-519bf5897514 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:49.767550 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d7161446-8863-4d58-ad00-519bf5897514 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:49.767987 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d7161446-8863-4d58-ad00-519bf5897514 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:49.768745 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d7161446-8863-4d58-ad00-519bf5897514 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:49.769175 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d7161446-8863-4d58-ad00-519bf5897514 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:49.830518 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d7161446-8863-4d58-ad00-519bf5897514 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28201 microversion: 2.1 time: 0.074594 Nov 08 16:20:49.831288 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 646/1301] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:49 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28201 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:49.835345 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2529fe8d-e7bc-4073-a606-dd178da46a6d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:49.836332 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-2529fe8d-e7bc-4073-a606-dd178da46a6d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:49.843156 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2529fe8d-e7bc-4073-a606-dd178da46a6d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:49.843596 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2529fe8d-e7bc-4073-a606-dd178da46a6d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:49.844358 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2529fe8d-e7bc-4073-a606-dd178da46a6d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:49.844785 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-2529fe8d-e7bc-4073-a606-dd178da46a6d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:49.907442 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2529fe8d-e7bc-4073-a606-dd178da46a6d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.076689 Nov 08 16:20:49.908292 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 656/1302] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:49 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:50.842989 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a2b51723-d65f-4464-979a-1d76d40c8b8b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:50.843971 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a2b51723-d65f-4464-979a-1d76d40c8b8b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:50.850760 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a2b51723-d65f-4464-979a-1d76d40c8b8b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:50.851200 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a2b51723-d65f-4464-979a-1d76d40c8b8b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:50.851962 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a2b51723-d65f-4464-979a-1d76d40c8b8b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:50.852390 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a2b51723-d65f-4464-979a-1d76d40c8b8b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:50.912580 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a2b51723-d65f-4464-979a-1d76d40c8b8b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28201 microversion: 2.1 time: 0.073498 Nov 08 16:20:50.913236 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 647/1303] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:50 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28201 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:50.919278 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c4f6ee93-295c-4f6c-8f19-d7a68a8d9344 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:50.920273 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c4f6ee93-295c-4f6c-8f19-d7a68a8d9344 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:50.927071 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c4f6ee93-295c-4f6c-8f19-d7a68a8d9344 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:50.928104 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c4f6ee93-295c-4f6c-8f19-d7a68a8d9344 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:50.928870 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c4f6ee93-295c-4f6c-8f19-d7a68a8d9344 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:50.929302 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c4f6ee93-295c-4f6c-8f19-d7a68a8d9344 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:50.989629 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c4f6ee93-295c-4f6c-8f19-d7a68a8d9344 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.074180 Nov 08 16:20:50.990783 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 657/1304] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:50 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:51.924952 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8364d40f-e55d-4d61-8876-c9b3f768c963 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:51.925909 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8364d40f-e55d-4d61-8876-c9b3f768c963 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:51.932699 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8364d40f-e55d-4d61-8876-c9b3f768c963 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:51.933143 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8364d40f-e55d-4d61-8876-c9b3f768c963 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:51.933934 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8364d40f-e55d-4d61-8876-c9b3f768c963 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:51.934367 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8364d40f-e55d-4d61-8876-c9b3f768c963 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:51.994480 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8364d40f-e55d-4d61-8876-c9b3f768c963 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28201 microversion: 2.1 time: 0.073578 Nov 08 16:20:51.995093 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 648/1305] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:51 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28201 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:52.002320 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ac756baa-bdff-4a45-8d2f-6e77ba664ffd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:52.003315 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ac756baa-bdff-4a45-8d2f-6e77ba664ffd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:52.010855 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ac756baa-bdff-4a45-8d2f-6e77ba664ffd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:52.011306 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ac756baa-bdff-4a45-8d2f-6e77ba664ffd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:52.012074 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ac756baa-bdff-4a45-8d2f-6e77ba664ffd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:52.012508 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ac756baa-bdff-4a45-8d2f-6e77ba664ffd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:52.072312 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ac756baa-bdff-4a45-8d2f-6e77ba664ffd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.073977 Nov 08 16:20:52.072922 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 658/1306] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:51 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:53.007405 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-df10b534-581c-42c9-bc34-d362f2ff9b14 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:53.008409 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-df10b534-581c-42c9-bc34-d362f2ff9b14 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:53.015309 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-df10b534-581c-42c9-bc34-d362f2ff9b14 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:53.015758 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-df10b534-581c-42c9-bc34-d362f2ff9b14 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:53.016559 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-df10b534-581c-42c9-bc34-d362f2ff9b14 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:53.016991 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-df10b534-581c-42c9-bc34-d362f2ff9b14 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:53.076297 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-df10b534-581c-42c9-bc34-d362f2ff9b14 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28201 microversion: 2.1 time: 0.073400 Nov 08 16:20:53.077174 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 649/1307] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:53 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28201 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:53.084417 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-be6a17b6-ea19-44dc-8be3-f6b3432e04aa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:53.085421 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-be6a17b6-ea19-44dc-8be3-f6b3432e04aa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:53.092295 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-be6a17b6-ea19-44dc-8be3-f6b3432e04aa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:53.092747 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-be6a17b6-ea19-44dc-8be3-f6b3432e04aa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:53.093520 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-be6a17b6-ea19-44dc-8be3-f6b3432e04aa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:53.093990 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-be6a17b6-ea19-44dc-8be3-f6b3432e04aa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:53.152110 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-be6a17b6-ea19-44dc-8be3-f6b3432e04aa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.071796 Nov 08 16:20:53.152735 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 659/1308] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:53 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:54.088997 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3cf5b017-c893-4f68-adfa-36c3e26d2d52 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:54.090023 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3cf5b017-c893-4f68-adfa-36c3e26d2d52 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:54.096752 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3cf5b017-c893-4f68-adfa-36c3e26d2d52 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:54.097192 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3cf5b017-c893-4f68-adfa-36c3e26d2d52 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:54.097984 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3cf5b017-c893-4f68-adfa-36c3e26d2d52 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:54.098407 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3cf5b017-c893-4f68-adfa-36c3e26d2d52 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:54.164157 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bcfea10f-5c90-4a36-8392-53046c5b7f1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:54.165151 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-bcfea10f-5c90-4a36-8392-53046c5b7f1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:54.172193 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bcfea10f-5c90-4a36-8392-53046c5b7f1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:54.172642 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bcfea10f-5c90-4a36-8392-53046c5b7f1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:54.173446 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bcfea10f-5c90-4a36-8392-53046c5b7f1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:54.173917 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bcfea10f-5c90-4a36-8392-53046c5b7f1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:54.185582 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3cf5b017-c893-4f68-adfa-36c3e26d2d52 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28492 microversion: 2.1 time: 0.100470 Nov 08 16:20:54.189564 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 650/1309] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:54 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28492 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:54.241269 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bcfea10f-5c90-4a36-8392-53046c5b7f1b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.081030 Nov 08 16:20:54.241998 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 660/1310] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:54 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:55.196897 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5e0360d9-f254-43dd-b6f4-145ae7d760be tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:55.198552 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5e0360d9-f254-43dd-b6f4-145ae7d760be tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:55.205307 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5e0360d9-f254-43dd-b6f4-145ae7d760be tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:55.205760 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5e0360d9-f254-43dd-b6f4-145ae7d760be tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:55.206520 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5e0360d9-f254-43dd-b6f4-145ae7d760be tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:55.206942 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5e0360d9-f254-43dd-b6f4-145ae7d760be tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:55.253201 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7cea8fdb-aa55-4dc8-a4f1-b1ee13db55e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:55.254153 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7cea8fdb-aa55-4dc8-a4f1-b1ee13db55e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:55.261476 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7cea8fdb-aa55-4dc8-a4f1-b1ee13db55e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:55.261951 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7cea8fdb-aa55-4dc8-a4f1-b1ee13db55e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:55.262725 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7cea8fdb-aa55-4dc8-a4f1-b1ee13db55e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:55.263162 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7cea8fdb-aa55-4dc8-a4f1-b1ee13db55e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:55.270336 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5e0360d9-f254-43dd-b6f4-145ae7d760be tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28492 microversion: 2.1 time: 0.077269 Nov 08 16:20:55.274423 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 651/1311] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:55 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28492 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:55.329481 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7cea8fdb-aa55-4dc8-a4f1-b1ee13db55e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.080243 Nov 08 16:20:55.330199 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 661/1312] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:55 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:56.281541 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-26e70005-41aa-4181-9c84-fbdb2dc88401 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:56.282557 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-26e70005-41aa-4181-9c84-fbdb2dc88401 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:56.289403 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-26e70005-41aa-4181-9c84-fbdb2dc88401 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:56.289883 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-26e70005-41aa-4181-9c84-fbdb2dc88401 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:56.290648 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-26e70005-41aa-4181-9c84-fbdb2dc88401 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:56.291080 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-26e70005-41aa-4181-9c84-fbdb2dc88401 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:56.342220 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-16de8dca-c1c8-4dea-8081-67d9b16158cc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:56.343191 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-16de8dca-c1c8-4dea-8081-67d9b16158cc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:56.349985 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-16de8dca-c1c8-4dea-8081-67d9b16158cc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:56.350433 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-16de8dca-c1c8-4dea-8081-67d9b16158cc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:56.351203 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-16de8dca-c1c8-4dea-8081-67d9b16158cc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:56.351634 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-16de8dca-c1c8-4dea-8081-67d9b16158cc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:58.708190 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-26e70005-41aa-4181-9c84-fbdb2dc88401 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 2.430398 Nov 08 16:20:58.709074 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 652/1313] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:56 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 2432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:58.713972 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-16de8dca-c1c8-4dea-8081-67d9b16158cc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 2.375731 Nov 08 16:20:58.714593 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 662/1314] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:56 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 2377 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:20:59.720515 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a5812bed-8c81-4e52-af25-78a4534d97b0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:59.721455 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a5812bed-8c81-4e52-af25-78a4534d97b0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:59.725196 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e9f5350b-3999-4090-9c58-4ac58e2c1224 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:20:59.726229 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e9f5350b-3999-4090-9c58-4ac58e2c1224 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:20:59.729207 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a5812bed-8c81-4e52-af25-78a4534d97b0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:59.729658 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a5812bed-8c81-4e52-af25-78a4534d97b0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:59.730453 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a5812bed-8c81-4e52-af25-78a4534d97b0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:59.730881 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a5812bed-8c81-4e52-af25-78a4534d97b0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:59.733872 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e9f5350b-3999-4090-9c58-4ac58e2c1224 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:59.734319 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e9f5350b-3999-4090-9c58-4ac58e2c1224 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:59.735090 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e9f5350b-3999-4090-9c58-4ac58e2c1224 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:20:59.735522 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e9f5350b-3999-4090-9c58-4ac58e2c1224 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:20:59.792735 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a5812bed-8c81-4e52-af25-78a4534d97b0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.076264 Nov 08 16:20:59.793600 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 653/1315] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:20:59 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:20:59.820838 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e9f5350b-3999-4090-9c58-4ac58e2c1224 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.100103 Nov 08 16:20:59.821464 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 663/1316] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:20:59 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:21:00.805399 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ce8821a2-a287-4fdb-8f84-bb5c27595df2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:00.806409 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ce8821a2-a287-4fdb-8f84-bb5c27595df2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:00.813192 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ce8821a2-a287-4fdb-8f84-bb5c27595df2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:00.813629 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ce8821a2-a287-4fdb-8f84-bb5c27595df2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:00.814411 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ce8821a2-a287-4fdb-8f84-bb5c27595df2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:00.814836 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ce8821a2-a287-4fdb-8f84-bb5c27595df2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:00.832704 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-68f0f92a-cd38-43b3-a53c-3c4f19a34f20 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:00.833770 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-68f0f92a-cd38-43b3-a53c-3c4f19a34f20 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:00.840453 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-68f0f92a-cd38-43b3-a53c-3c4f19a34f20 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:00.840904 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-68f0f92a-cd38-43b3-a53c-3c4f19a34f20 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:00.841732 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-68f0f92a-cd38-43b3-a53c-3c4f19a34f20 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:00.842169 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-68f0f92a-cd38-43b3-a53c-3c4f19a34f20 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:00.924766 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ce8821a2-a287-4fdb-8f84-bb5c27595df2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.123801 Nov 08 16:21:00.925407 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 654/1317] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:00 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:00.940998 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-68f0f92a-cd38-43b3-a53c-3c4f19a34f20 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.112201 Nov 08 16:21:00.941628 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 664/1318] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:21:00 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:21:01.937411 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a8bc9103-79c7-49cd-a0d5-9ad562661dd7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:01.938346 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a8bc9103-79c7-49cd-a0d5-9ad562661dd7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:01.945744 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a8bc9103-79c7-49cd-a0d5-9ad562661dd7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:01.946188 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a8bc9103-79c7-49cd-a0d5-9ad562661dd7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:01.946956 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a8bc9103-79c7-49cd-a0d5-9ad562661dd7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:01.947463 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a8bc9103-79c7-49cd-a0d5-9ad562661dd7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:01.952742 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4663209b-6cbe-4e82-a1dc-cbcd53cfcb91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:01.953764 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4663209b-6cbe-4e82-a1dc-cbcd53cfcb91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:01.960595 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4663209b-6cbe-4e82-a1dc-cbcd53cfcb91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:01.961047 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4663209b-6cbe-4e82-a1dc-cbcd53cfcb91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:01.961845 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4663209b-6cbe-4e82-a1dc-cbcd53cfcb91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:01.962280 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4663209b-6cbe-4e82-a1dc-cbcd53cfcb91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:02.066418 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a8bc9103-79c7-49cd-a0d5-9ad562661dd7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.132921 Nov 08 16:21:02.067064 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 655/1319] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:01 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:02.096553 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4663209b-6cbe-4e82-a1dc-cbcd53cfcb91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.147716 Nov 08 16:21:02.097193 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 665/1320] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:21:01 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:21:03.079061 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4b374559-ef28-46eb-819d-e742e426930b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:03.080055 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4b374559-ef28-46eb-819d-e742e426930b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:03.087536 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4b374559-ef28-46eb-819d-e742e426930b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:03.087980 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4b374559-ef28-46eb-819d-e742e426930b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:03.088752 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4b374559-ef28-46eb-819d-e742e426930b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:03.089183 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4b374559-ef28-46eb-819d-e742e426930b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:03.108865 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0a6fc89c-24d6-4cce-97e6-2aef813d31e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:03.110512 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0a6fc89c-24d6-4cce-97e6-2aef813d31e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:03.117620 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0a6fc89c-24d6-4cce-97e6-2aef813d31e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:03.118098 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0a6fc89c-24d6-4cce-97e6-2aef813d31e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:03.118938 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0a6fc89c-24d6-4cce-97e6-2aef813d31e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:03.119377 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0a6fc89c-24d6-4cce-97e6-2aef813d31e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:03.154450 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4b374559-ef28-46eb-819d-e742e426930b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.079200 Nov 08 16:21:03.155110 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 656/1321] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:03 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:03.211312 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0a6fc89c-24d6-4cce-97e6-2aef813d31e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.106407 Nov 08 16:21:03.211932 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 666/1322] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:21:03 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:21:04.167087 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-776d0dd2-8758-4b07-b508-0daa5397cd79 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:04.168115 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-776d0dd2-8758-4b07-b508-0daa5397cd79 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:04.174992 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-776d0dd2-8758-4b07-b508-0daa5397cd79 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:04.175437 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-776d0dd2-8758-4b07-b508-0daa5397cd79 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:04.176207 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-776d0dd2-8758-4b07-b508-0daa5397cd79 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:04.176670 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-776d0dd2-8758-4b07-b508-0daa5397cd79 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:04.223083 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3f5aaa6d-63ea-481b-8aac-d56d15f0d94e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:04.224668 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3f5aaa6d-63ea-481b-8aac-d56d15f0d94e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:04.231488 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3f5aaa6d-63ea-481b-8aac-d56d15f0d94e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:04.231937 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3f5aaa6d-63ea-481b-8aac-d56d15f0d94e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:04.232709 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3f5aaa6d-63ea-481b-8aac-d56d15f0d94e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:04.233150 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3f5aaa6d-63ea-481b-8aac-d56d15f0d94e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:04.319166 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3f5aaa6d-63ea-481b-8aac-d56d15f0d94e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.099945 Nov 08 16:21:04.319783 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 667/1323] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:21:04 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:21:04.734140 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-776d0dd2-8758-4b07-b508-0daa5397cd79 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.570815 Nov 08 16:21:04.734784 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 657/1324] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:04 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:05.331358 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0e73de72-5266-4db9-84a3-b15e054d2c10 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:05.332342 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0e73de72-5266-4db9-84a3-b15e054d2c10 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:05.340086 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0e73de72-5266-4db9-84a3-b15e054d2c10 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:05.340473 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0e73de72-5266-4db9-84a3-b15e054d2c10 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:05.341230 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0e73de72-5266-4db9-84a3-b15e054d2c10 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:05.341655 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0e73de72-5266-4db9-84a3-b15e054d2c10 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:05.403936 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0e73de72-5266-4db9-84a3-b15e054d2c10 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 28679 microversion: 2.20 time: 0.076539 Nov 08 16:21:05.404550 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 668/1325] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:21:05 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 28679 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:21:05.746584 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-686973e9-a639-4239-ac0e-8141c01515ed tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:05.747492 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-686973e9-a639-4239-ac0e-8141c01515ed tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:05.754247 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-686973e9-a639-4239-ac0e-8141c01515ed tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:05.755383 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-686973e9-a639-4239-ac0e-8141c01515ed tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:05.756201 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-686973e9-a639-4239-ac0e-8141c01515ed tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:05.756464 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-686973e9-a639-4239-ac0e-8141c01515ed tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:05.901740 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-686973e9-a639-4239-ac0e-8141c01515ed tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.159333 Nov 08 16:21:05.902587 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 658/1326] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:05 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:05.936045 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1172356431", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1157858539", "security_groups": [{"name": "tempest-secgroup-smoke-706634952"}], "block_device_mapping_v2": [{"uuid": "128d421e-2ca6-4adc-82b4-fe604d122d71", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a15e051b-c130-4140-aaf2-a45ea7af5b43"}]}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:06.042461 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.network.neutron [None req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] validate_networks() for [('a15e051b-c130-4140-aaf2-a45ea7af5b43', None, None, None, None, None)] {{(pid=115524) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:21:06.415847 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-81a71195-f75f-4916-b0d6-f3074b186dcc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:06.416879 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-81a71195-f75f-4916-b0d6-f3074b186dcc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:06.423710 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-81a71195-f75f-4916-b0d6-f3074b186dcc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:06.424150 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-81a71195-f75f-4916-b0d6-f3074b186dcc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:06.424923 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-81a71195-f75f-4916-b0d6-f3074b186dcc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:06.425350 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-81a71195-f75f-4916-b0d6-f3074b186dcc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:06.444260 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Flavor limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:21:06.444758 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Image limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:21:06.445152 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Flavor pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:21:06.445553 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Image pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:21:06.445987 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:21:06.454390 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:06.454825 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:06.455623 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:06.456054 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:06.474399 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Getting quotas for project 343d5ca096394f87bea0950aa3811a13. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:21:06.478198 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Getting quotas for user e81a95f368744b3eb9fd85a9c6e0c8ed and project 343d5ca096394f87bea0950aa3811a13. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:21:06.506229 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-81a71195-f75f-4916-b0d6-f3074b186dcc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 30400 microversion: 2.20 time: 0.094823 Nov 08 16:21:06.507080 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 659/1327] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:21:06 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 30400 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:21:06.532214 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Going to run 1 instances... {{(pid=115524) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:21:06.534465 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='128d421e-2ca6-4adc-82b4-fe604d122d71',volume_size=None,volume_type=None)] {{(pid=115524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:21:06.653326 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [474cdaa5-8b8d-4352-aec7-5f2a2930b1e2] AMQP server on 10.222.0.37:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 08 16:21:06.913387 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-09ef4574-e943-4e93-8b16-1bbea3e57a8b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:06.914413 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-09ef4574-e943-4e93-8b16-1bbea3e57a8b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:06.921397 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-09ef4574-e943-4e93-8b16-1bbea3e57a8b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:06.921884 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-09ef4574-e943-4e93-8b16-1bbea3e57a8b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:06.922670 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-09ef4574-e943-4e93-8b16-1bbea3e57a8b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:06.923104 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-09ef4574-e943-4e93-8b16-1bbea3e57a8b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:06.986930 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-09ef4574-e943-4e93-8b16-1bbea3e57a8b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.078036 Nov 08 16:21:06.987565 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 660/1328] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:06 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:21:07.518241 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9adf5c1f-c78f-488a-ace5-6b418685751d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:07.519217 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-9adf5c1f-c78f-488a-ace5-6b418685751d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:07.526612 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9adf5c1f-c78f-488a-ace5-6b418685751d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:07.527048 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9adf5c1f-c78f-488a-ace5-6b418685751d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:07.527806 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9adf5c1f-c78f-488a-ace5-6b418685751d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:07.528223 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9adf5c1f-c78f-488a-ace5-6b418685751d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:07.606646 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-9adf5c1f-c78f-488a-ace5-6b418685751d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 32287 microversion: 2.20 time: 0.092397 Nov 08 16:21:07.607263 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 661/1329] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:21:07 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 32287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:21:07.669684 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO oslo.messaging._drivers.impl_rabbit [None req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [474cdaa5-8b8d-4352-aec7-5f2a2930b1e2] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 49232. Nov 08 16:21:07.674033 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.741991 Nov 08 16:21:07.674679 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 669/1330] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Nov 8 16:21:05 2021] POST /compute/v2.1/servers => generated 405 bytes in 1743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 16:21:07.685343 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c8649b46-57f9-45e9-8445-8b10a0abe097 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:07.686050 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c8649b46-57f9-45e9-8445-8b10a0abe097 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:07.739881 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c8649b46-57f9-45e9-8445-8b10a0abe097 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:07.747260 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c8649b46-57f9-45e9-8445-8b10a0abe097 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1095 microversion: 2.1 time: 0.065931 Nov 08 16:21:07.752409 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 662/1331] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:07 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:21:07.999495 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-da037cc2-29b1-4db8-a2f5-7b0b4fe9b485 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:08.000614 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-da037cc2-29b1-4db8-a2f5-7b0b4fe9b485 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:08.008639 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-da037cc2-29b1-4db8-a2f5-7b0b4fe9b485 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:08.009093 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-da037cc2-29b1-4db8-a2f5-7b0b4fe9b485 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:08.009926 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-da037cc2-29b1-4db8-a2f5-7b0b4fe9b485 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:08.010378 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-da037cc2-29b1-4db8-a2f5-7b0b4fe9b485 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:08.073972 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-da037cc2-29b1-4db8-a2f5-7b0b4fe9b485 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.077940 Nov 08 16:21:08.074613 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 670/1332] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:07 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:08.618840 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ad866904-3cfc-4fa5-b5c4-c36fc794c89c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:08.619809 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ad866904-3cfc-4fa5-b5c4-c36fc794c89c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:08.627058 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ad866904-3cfc-4fa5-b5c4-c36fc794c89c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:08.627502 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ad866904-3cfc-4fa5-b5c4-c36fc794c89c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:08.628297 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ad866904-3cfc-4fa5-b5c4-c36fc794c89c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:08.628733 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ad866904-3cfc-4fa5-b5c4-c36fc794c89c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:08.742743 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ad866904-3cfc-4fa5-b5c4-c36fc794c89c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 33519 microversion: 2.20 time: 0.127624 Nov 08 16:21:08.743948 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 663/1333] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:21:08 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 33519 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:21:08.765940 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e1d7d772-93dc-4e27-9221-790bce7f924b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:08.766724 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e1d7d772-93dc-4e27-9221-790bce7f924b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:08.774258 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e1d7d772-93dc-4e27-9221-790bce7f924b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:08.774712 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e1d7d772-93dc-4e27-9221-790bce7f924b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:08.775500 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e1d7d772-93dc-4e27-9221-790bce7f924b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:08.775937 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e1d7d772-93dc-4e27-9221-790bce7f924b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:08.846799 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e1d7d772-93dc-4e27-9221-790bce7f924b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:08.854483 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e1d7d772-93dc-4e27-9221-790bce7f924b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1211 microversion: 2.1 time: 0.092902 Nov 08 16:21:08.855040 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 671/1334] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:08 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:21:09.088069 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-50188419-06d7-4fbb-9f5c-9b014a898d4f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:09.089157 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-50188419-06d7-4fbb-9f5c-9b014a898d4f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:09.095953 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-50188419-06d7-4fbb-9f5c-9b014a898d4f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:09.096479 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-50188419-06d7-4fbb-9f5c-9b014a898d4f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:09.097333 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-50188419-06d7-4fbb-9f5c-9b014a898d4f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:09.097860 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-50188419-06d7-4fbb-9f5c-9b014a898d4f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:09.168838 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-50188419-06d7-4fbb-9f5c-9b014a898d4f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.086423 Nov 08 16:21:09.169414 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 664/1335] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:09 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:09.755199 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f870984b-f317-4634-9cc1-7164d436dba5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:09.756706 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f870984b-f317-4634-9cc1-7164d436dba5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:09.763988 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f870984b-f317-4634-9cc1-7164d436dba5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:09.764543 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f870984b-f317-4634-9cc1-7164d436dba5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:09.765583 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f870984b-f317-4634-9cc1-7164d436dba5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:09.766607 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f870984b-f317-4634-9cc1-7164d436dba5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:09.851076 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f870984b-f317-4634-9cc1-7164d436dba5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 34453 microversion: 2.20 time: 0.099629 Nov 08 16:21:09.851729 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 672/1336] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:21:09 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 34453 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:21:09.872097 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b8f9d6ba-c014-4bae-a22d-50b012553aa4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:09.872786 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b8f9d6ba-c014-4bae-a22d-50b012553aa4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:09.880428 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b8f9d6ba-c014-4bae-a22d-50b012553aa4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:09.881179 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b8f9d6ba-c014-4bae-a22d-50b012553aa4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:09.881991 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b8f9d6ba-c014-4bae-a22d-50b012553aa4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:09.883008 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b8f9d6ba-c014-4bae-a22d-50b012553aa4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:09.999099 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-c5f6b534-2270-42a7-a40b-217536f35449 req-f950650e-26c8-4048-9794-ea7ec71f8956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f664b3dd-4458-4525-926a-1321ff188fdc", "tag": "ac61ca49-2eb1-4040-99b3-1fc5285b703f"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:10.000550 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:21:10.000550 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:21:10.034868 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-c5f6b534-2270-42a7-a40b-217536f35449 req-f950650e-26c8-4048-9794-ea7ec71f8956 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:10.036435 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-c5f6b534-2270-42a7-a40b-217536f35449 req-f950650e-26c8-4048-9794-ea7ec71f8956 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:10.050752 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-c5f6b534-2270-42a7-a40b-217536f35449 req-f950650e-26c8-4048-9794-ea7ec71f8956 service nova] Creating event network-changed:ac61ca49-2eb1-4040-99b3-1fc5285b703f for instance f664b3dd-4458-4525-926a-1321ff188fdc on hv-cinder-81618 Nov 08 16:21:10.056561 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-c5f6b534-2270-42a7-a40b-217536f35449 req-f950650e-26c8-4048-9794-ea7ec71f8956 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061645 Nov 08 16:21:10.057850 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 673/1337] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:21:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:21:10.163341 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b8f9d6ba-c014-4bae-a22d-50b012553aa4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:10.170993 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b8f9d6ba-c014-4bae-a22d-50b012553aa4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1266 microversion: 2.1 time: 0.302921 Nov 08 16:21:10.171570 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 665/1338] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:09 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1266 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:21:10.186490 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-77771a29-05a5-4d7c-baf5-c81dde362f50 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:10.187553 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-77771a29-05a5-4d7c-baf5-c81dde362f50 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:10.193635 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-77771a29-05a5-4d7c-baf5-c81dde362f50 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:10.194131 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-77771a29-05a5-4d7c-baf5-c81dde362f50 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:10.194909 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-77771a29-05a5-4d7c-baf5-c81dde362f50 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:10.195342 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-77771a29-05a5-4d7c-baf5-c81dde362f50 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:10.284086 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-77771a29-05a5-4d7c-baf5-c81dde362f50 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.101970 Nov 08 16:21:10.285633 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 674/1339] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:10 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:10.863237 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-457a80b8-dc6b-4c82-a3b2-a9dd2b6c3a4e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:10.864591 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-457a80b8-dc6b-4c82-a3b2-a9dd2b6c3a4e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:10.872498 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-457a80b8-dc6b-4c82-a3b2-a9dd2b6c3a4e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:10.873040 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-457a80b8-dc6b-4c82-a3b2-a9dd2b6c3a4e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:10.873744 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-457a80b8-dc6b-4c82-a3b2-a9dd2b6c3a4e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:10.874166 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-457a80b8-dc6b-4c82-a3b2-a9dd2b6c3a4e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:11.080241 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-457a80b8-dc6b-4c82-a3b2-a9dd2b6c3a4e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 35695 microversion: 2.20 time: 0.220635 Nov 08 16:21:11.080925 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 666/1340] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:21:10 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 35695 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:21:11.188310 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d9fd8962-946d-4875-9e59-efadd547df1c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:11.188927 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d9fd8962-946d-4875-9e59-efadd547df1c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:11.196270 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d9fd8962-946d-4875-9e59-efadd547df1c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:11.196725 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d9fd8962-946d-4875-9e59-efadd547df1c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:11.197503 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d9fd8962-946d-4875-9e59-efadd547df1c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:11.197977 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d9fd8962-946d-4875-9e59-efadd547df1c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:11.295951 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-034b0316-4ed6-4f6f-8191-6cb8901317db tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:11.296974 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-034b0316-4ed6-4f6f-8191-6cb8901317db tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:11.304742 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-034b0316-4ed6-4f6f-8191-6cb8901317db tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:11.305197 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-034b0316-4ed6-4f6f-8191-6cb8901317db tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:11.306007 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-034b0316-4ed6-4f6f-8191-6cb8901317db tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:11.306440 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-034b0316-4ed6-4f6f-8191-6cb8901317db tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:11.328550 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-d9fd8962-946d-4875-9e59-efadd547df1c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:11.336602 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d9fd8962-946d-4875-9e59-efadd547df1c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1266 microversion: 2.1 time: 0.152469 Nov 08 16:21:11.337166 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 675/1341] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:11 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:21:11.505607 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-034b0316-4ed6-4f6f-8191-6cb8901317db tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.213401 Nov 08 16:21:11.506220 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 667/1342] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:11 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:21:12.092240 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1320a08c-a8bb-4b8c-bec5-9db8812812ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:12.093194 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1320a08c-a8bb-4b8c-bec5-9db8812812ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:12.100014 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1320a08c-a8bb-4b8c-bec5-9db8812812ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:12.100462 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1320a08c-a8bb-4b8c-bec5-9db8812812ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:12.101332 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1320a08c-a8bb-4b8c-bec5-9db8812812ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:12.101797 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1320a08c-a8bb-4b8c-bec5-9db8812812ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:12.177041 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1320a08c-a8bb-4b8c-bec5-9db8812812ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 37027 microversion: 2.20 time: 0.087782 Nov 08 16:21:12.177660 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 676/1343] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:21:12 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 37027 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:21:12.354246 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-622c281b-e09d-471c-acb3-0d84ddc0d4de tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:12.354838 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-622c281b-e09d-471c-acb3-0d84ddc0d4de tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:12.361604 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-622c281b-e09d-471c-acb3-0d84ddc0d4de tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:12.362067 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-622c281b-e09d-471c-acb3-0d84ddc0d4de tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:12.362831 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-622c281b-e09d-471c-acb3-0d84ddc0d4de tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:12.363259 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-622c281b-e09d-471c-acb3-0d84ddc0d4de tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:12.494027 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-622c281b-e09d-471c-acb3-0d84ddc0d4de tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:12.501779 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-622c281b-e09d-471c-acb3-0d84ddc0d4de tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1266 microversion: 2.1 time: 0.151669 Nov 08 16:21:12.502373 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 668/1344] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:12 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:21:12.516948 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-cbf93c21-3647-46ba-96d1-0d2d955545d1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:12.517991 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-cbf93c21-3647-46ba-96d1-0d2d955545d1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:12.526367 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cbf93c21-3647-46ba-96d1-0d2d955545d1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:12.526826 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cbf93c21-3647-46ba-96d1-0d2d955545d1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:12.527604 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cbf93c21-3647-46ba-96d1-0d2d955545d1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:12.528072 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cbf93c21-3647-46ba-96d1-0d2d955545d1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:12.593926 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-cbf93c21-3647-46ba-96d1-0d2d955545d1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.080900 Nov 08 16:21:12.594539 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 677/1345] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:12 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:21:13.188678 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1415c3ea-15d8-4ba4-bdca-722fbe2a950e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:13.189576 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1415c3ea-15d8-4ba4-bdca-722fbe2a950e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:13.195817 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1415c3ea-15d8-4ba4-bdca-722fbe2a950e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:13.196247 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1415c3ea-15d8-4ba4-bdca-722fbe2a950e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:13.196998 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1415c3ea-15d8-4ba4-bdca-722fbe2a950e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:13.197420 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1415c3ea-15d8-4ba4-bdca-722fbe2a950e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:13.268894 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1415c3ea-15d8-4ba4-bdca-722fbe2a950e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 38233 microversion: 2.20 time: 0.083786 Nov 08 16:21:13.269518 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 669/1346] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:21:13 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 38233 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:21:13.518830 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e7368fe3-ea33-4fec-99ad-a05781ebc93e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:13.519531 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e7368fe3-ea33-4fec-99ad-a05781ebc93e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:13.526439 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e7368fe3-ea33-4fec-99ad-a05781ebc93e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:13.526893 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e7368fe3-ea33-4fec-99ad-a05781ebc93e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:13.527663 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e7368fe3-ea33-4fec-99ad-a05781ebc93e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:13.528102 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e7368fe3-ea33-4fec-99ad-a05781ebc93e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:13.606703 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-58ec526b-4980-433d-bcc6-bc4e66929f38 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:13.607732 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-58ec526b-4980-433d-bcc6-bc4e66929f38 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:13.615054 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-58ec526b-4980-433d-bcc6-bc4e66929f38 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:13.615493 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-58ec526b-4980-433d-bcc6-bc4e66929f38 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:13.616382 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-58ec526b-4980-433d-bcc6-bc4e66929f38 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:13.617063 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-58ec526b-4980-433d-bcc6-bc4e66929f38 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:13.658359 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e7368fe3-ea33-4fec-99ad-a05781ebc93e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:13.666522 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e7368fe3-ea33-4fec-99ad-a05781ebc93e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1266 microversion: 2.1 time: 0.151715 Nov 08 16:21:13.667075 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 678/1347] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:13 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:21:13.678291 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-58ec526b-4980-433d-bcc6-bc4e66929f38 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.075446 Nov 08 16:21:13.678926 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 670/1348] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:13 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:21:14.281189 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b59ced0f-b322-4977-8690-00f6065103a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:14.282115 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b59ced0f-b322-4977-8690-00f6065103a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:14.288861 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b59ced0f-b322-4977-8690-00f6065103a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:14.289301 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b59ced0f-b322-4977-8690-00f6065103a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:14.290097 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b59ced0f-b322-4977-8690-00f6065103a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:14.290547 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b59ced0f-b322-4977-8690-00f6065103a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:14.350886 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b59ced0f-b322-4977-8690-00f6065103a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 38233 microversion: 2.20 time: 0.073280 Nov 08 16:21:14.351529 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 679/1349] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:21:14 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 38233 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:21:14.683231 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ffe40913-2383-4310-a432-8e6fef25cab3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:14.683834 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ffe40913-2383-4310-a432-8e6fef25cab3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:14.690036 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-fbf3cc74-a0e3-4d59-9fd0-c759e57de81b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:14.690655 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ffe40913-2383-4310-a432-8e6fef25cab3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:14.691043 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-fbf3cc74-a0e3-4d59-9fd0-c759e57de81b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:14.691167 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ffe40913-2383-4310-a432-8e6fef25cab3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:14.692508 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ffe40913-2383-4310-a432-8e6fef25cab3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:14.692931 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ffe40913-2383-4310-a432-8e6fef25cab3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:14.697968 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fbf3cc74-a0e3-4d59-9fd0-c759e57de81b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:14.698260 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fbf3cc74-a0e3-4d59-9fd0-c759e57de81b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:14.699033 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fbf3cc74-a0e3-4d59-9fd0-c759e57de81b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:14.699494 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-fbf3cc74-a0e3-4d59-9fd0-c759e57de81b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:14.763335 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-fbf3cc74-a0e3-4d59-9fd0-c759e57de81b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.077201 Nov 08 16:21:14.767216 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 680/1350] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:14 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:21:14.827439 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ffe40913-2383-4310-a432-8e6fef25cab3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:14.834605 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ffe40913-2383-4310-a432-8e6fef25cab3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1266 microversion: 2.1 time: 0.155501 Nov 08 16:21:14.835170 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 671/1351] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:14 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:21:15.500975 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bd1dde86-0296-4047-9a06-9ab50da78c04 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:15.501989 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-bd1dde86-0296-4047-9a06-9ab50da78c04 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:15.509193 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bd1dde86-0296-4047-9a06-9ab50da78c04 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:15.509641 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bd1dde86-0296-4047-9a06-9ab50da78c04 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:15.510459 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bd1dde86-0296-4047-9a06-9ab50da78c04 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:15.510893 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bd1dde86-0296-4047-9a06-9ab50da78c04 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:15.573317 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bd1dde86-0296-4047-9a06-9ab50da78c04 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 38233 microversion: 2.20 time: 0.214595 Nov 08 16:21:15.573937 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 681/1352] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:21:15 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 38233 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:21:15.774895 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4fda39d6-7b42-47a2-8c6f-8308a413111d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:15.775818 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4fda39d6-7b42-47a2-8c6f-8308a413111d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:15.782092 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4fda39d6-7b42-47a2-8c6f-8308a413111d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:15.782535 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4fda39d6-7b42-47a2-8c6f-8308a413111d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:15.783307 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4fda39d6-7b42-47a2-8c6f-8308a413111d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:15.783740 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4fda39d6-7b42-47a2-8c6f-8308a413111d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:15.844574 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4fda39d6-7b42-47a2-8c6f-8308a413111d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.073289 Nov 08 16:21:15.845205 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 672/1353] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:15 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:15.852116 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5af49783-e116-41b6-9ee5-0e294deb45ee tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:15.852841 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5af49783-e116-41b6-9ee5-0e294deb45ee tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:15.859641 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5af49783-e116-41b6-9ee5-0e294deb45ee tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:15.860089 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5af49783-e116-41b6-9ee5-0e294deb45ee tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:15.860855 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5af49783-e116-41b6-9ee5-0e294deb45ee tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:15.861289 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5af49783-e116-41b6-9ee5-0e294deb45ee tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:15.991443 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-5af49783-e116-41b6-9ee5-0e294deb45ee tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:15.999322 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5af49783-e116-41b6-9ee5-0e294deb45ee tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1266 microversion: 2.1 time: 0.151788 Nov 08 16:21:15.999883 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 682/1354] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:15 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:21:16.586243 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b9a09907-3061-4f73-93fc-9bc4cb7f7f9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:16.587241 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b9a09907-3061-4f73-93fc-9bc4cb7f7f9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:16.594079 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b9a09907-3061-4f73-93fc-9bc4cb7f7f9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:16.594517 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b9a09907-3061-4f73-93fc-9bc4cb7f7f9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:16.595284 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b9a09907-3061-4f73-93fc-9bc4cb7f7f9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:16.595710 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b9a09907-3061-4f73-93fc-9bc4cb7f7f9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:16.661448 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b9a09907-3061-4f73-93fc-9bc4cb7f7f9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 38233 microversion: 2.20 time: 0.079869 Nov 08 16:21:16.662350 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 673/1355] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:21:16 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 38233 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:21:16.856712 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-acee03b5-8fef-44bf-b0fb-a126a49dd7c5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:16.857536 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-acee03b5-8fef-44bf-b0fb-a126a49dd7c5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:16.864263 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-acee03b5-8fef-44bf-b0fb-a126a49dd7c5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:16.864740 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-acee03b5-8fef-44bf-b0fb-a126a49dd7c5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:16.865548 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-acee03b5-8fef-44bf-b0fb-a126a49dd7c5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:16.866018 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-acee03b5-8fef-44bf-b0fb-a126a49dd7c5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:16.930011 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-acee03b5-8fef-44bf-b0fb-a126a49dd7c5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.076900 Nov 08 16:21:16.930622 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 683/1356] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:16 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:17.016750 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1e1906de-ea43-4813-bcb1-10031d22cb6e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:17.017435 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1e1906de-ea43-4813-bcb1-10031d22cb6e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:17.024243 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1e1906de-ea43-4813-bcb1-10031d22cb6e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:17.024684 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1e1906de-ea43-4813-bcb1-10031d22cb6e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:17.025442 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1e1906de-ea43-4813-bcb1-10031d22cb6e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:17.025890 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1e1906de-ea43-4813-bcb1-10031d22cb6e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:17.153510 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1e1906de-ea43-4813-bcb1-10031d22cb6e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:17.161793 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1e1906de-ea43-4813-bcb1-10031d22cb6e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1266 microversion: 2.1 time: 0.149016 Nov 08 16:21:17.162353 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 674/1357] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:17 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:21:17.673648 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1e0df0e2-82a0-4a1c-84dd-f2147c68b5b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:17.674668 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1e0df0e2-82a0-4a1c-84dd-f2147c68b5b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:17.682066 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1e0df0e2-82a0-4a1c-84dd-f2147c68b5b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:17.682513 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1e0df0e2-82a0-4a1c-84dd-f2147c68b5b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:17.683280 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1e0df0e2-82a0-4a1c-84dd-f2147c68b5b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:17.683712 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1e0df0e2-82a0-4a1c-84dd-f2147c68b5b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:17.884557 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1e0df0e2-82a0-4a1c-84dd-f2147c68b5b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 200 len: 38376 microversion: 2.20 time: 0.214768 Nov 08 16:21:17.885188 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 684/1358] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:21:17 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 38376 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:21:17.894934 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0abc46ca-b200-4d9e-b61a-9381cc13cf05 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:17.895425 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0abc46ca-b200-4d9e-b61a-9381cc13cf05 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:17.901612 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0abc46ca-b200-4d9e-b61a-9381cc13cf05 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:17.902084 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0abc46ca-b200-4d9e-b61a-9381cc13cf05 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:17.902882 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0abc46ca-b200-4d9e-b61a-9381cc13cf05 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:17.903310 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0abc46ca-b200-4d9e-b61a-9381cc13cf05 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:17.928883 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0abc46ca-b200-4d9e-b61a-9381cc13cf05 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/ips" status: 200 len: 152 microversion: 2.20 time: 0.037644 Nov 08 16:21:17.929463 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 675/1359] 10.222.0.37 () {60 vars in 1288 bytes} [Mon Nov 8 16:21:17 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:17.942048 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-8f881628-a437-4a73-9d26-db646f0b3ca6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:17.943048 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-8f881628-a437-4a73-9d26-db646f0b3ca6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:17.949997 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8f881628-a437-4a73-9d26-db646f0b3ca6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:17.950452 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8f881628-a437-4a73-9d26-db646f0b3ca6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:17.951228 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8f881628-a437-4a73-9d26-db646f0b3ca6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:17.951665 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8f881628-a437-4a73-9d26-db646f0b3ca6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:18.034143 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-8f881628-a437-4a73-9d26-db646f0b3ca6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.095947 Nov 08 16:21:18.035059 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 685/1360] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:17 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:18.178804 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-7ce7035c-403b-421a-9d3c-11f7106ba08b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:18.179402 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-7ce7035c-403b-421a-9d3c-11f7106ba08b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:18.185597 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7ce7035c-403b-421a-9d3c-11f7106ba08b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:18.186283 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7ce7035c-403b-421a-9d3c-11f7106ba08b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:18.187058 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7ce7035c-403b-421a-9d3c-11f7106ba08b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:18.187484 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7ce7035c-403b-421a-9d3c-11f7106ba08b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:18.321244 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7ce7035c-403b-421a-9d3c-11f7106ba08b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:18.328481 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-7ce7035c-403b-421a-9d3c-11f7106ba08b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1266 microversion: 2.1 time: 0.153373 Nov 08 16:21:18.329048 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 676/1361] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:18 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:21:19.046341 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d49eb620-60b5-4812-b739-b3be9e2b84e0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:19.047341 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d49eb620-60b5-4812-b739-b3be9e2b84e0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:19.055326 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d49eb620-60b5-4812-b739-b3be9e2b84e0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:19.055771 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d49eb620-60b5-4812-b739-b3be9e2b84e0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:19.056539 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d49eb620-60b5-4812-b739-b3be9e2b84e0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:19.056976 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d49eb620-60b5-4812-b739-b3be9e2b84e0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:19.135544 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d49eb620-60b5-4812-b739-b3be9e2b84e0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.093210 Nov 08 16:21:19.136174 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 686/1362] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:19 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:19.344589 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-68fe4749-0f1d-4455-9179-e1135a7a0a22 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:19.345199 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-68fe4749-0f1d-4455-9179-e1135a7a0a22 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:19.351907 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-68fe4749-0f1d-4455-9179-e1135a7a0a22 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:19.352433 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-68fe4749-0f1d-4455-9179-e1135a7a0a22 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:19.353252 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-68fe4749-0f1d-4455-9179-e1135a7a0a22 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:19.353676 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-68fe4749-0f1d-4455-9179-e1135a7a0a22 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:19.480653 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-68fe4749-0f1d-4455-9179-e1135a7a0a22 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:19.487822 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-68fe4749-0f1d-4455-9179-e1135a7a0a22 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1266 microversion: 2.1 time: 0.147011 Nov 08 16:21:19.488400 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 677/1363] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:19 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:21:20.147557 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-68005ddd-be29-42b0-8079-c50c434d5329 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:20.148563 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-68005ddd-be29-42b0-8079-c50c434d5329 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:20.155401 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-68005ddd-be29-42b0-8079-c50c434d5329 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:20.155852 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-68005ddd-be29-42b0-8079-c50c434d5329 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:20.156629 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-68005ddd-be29-42b0-8079-c50c434d5329 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:20.157064 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-68005ddd-be29-42b0-8079-c50c434d5329 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:20.232686 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-68005ddd-be29-42b0-8079-c50c434d5329 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.089020 Nov 08 16:21:20.236791 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 687/1364] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:20 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:20.351149 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-deed838f-892c-4a6c-a458-8aa582c206a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:20.351686 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-deed838f-892c-4a6c-a458-8aa582c206a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:20.357699 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-deed838f-892c-4a6c-a458-8aa582c206a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:20.358219 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-deed838f-892c-4a6c-a458-8aa582c206a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:20.358995 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-deed838f-892c-4a6c-a458-8aa582c206a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:20.359421 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-deed838f-892c-4a6c-a458-8aa582c206a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:20.383228 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.objects.instance [None req-deed838f-892c-4a6c-a458-8aa582c206a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lazy-loading 'flavor' on Instance uuid f0c4ded0-3419-458b-ab12-da310a2b2fd7 {{(pid=115523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:21:20.505292 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1095a26f-a7d8-41df-bce2-02e2ceab3fdd tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:20.506160 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1095a26f-a7d8-41df-bce2-02e2ceab3fdd tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:20.513272 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1095a26f-a7d8-41df-bce2-02e2ceab3fdd tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:20.513755 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1095a26f-a7d8-41df-bce2-02e2ceab3fdd tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:20.514542 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1095a26f-a7d8-41df-bce2-02e2ceab3fdd tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:20.515044 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1095a26f-a7d8-41df-bce2-02e2ceab3fdd tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:20.640544 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-deed838f-892c-4a6c-a458-8aa582c206a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 202 len: 0 microversion: 2.20 time: 0.293211 Nov 08 16:21:20.644705 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 678/1365] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:21:20 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:21:20.649971 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-13c288aa-3d1c-4eff-a9f2-9cbc1c21f56f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:20.650664 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-13c288aa-3d1c-4eff-a9f2-9cbc1c21f56f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:20.657556 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-13c288aa-3d1c-4eff-a9f2-9cbc1c21f56f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:20.658098 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-13c288aa-3d1c-4eff-a9f2-9cbc1c21f56f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:20.658885 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-13c288aa-3d1c-4eff-a9f2-9cbc1c21f56f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:20.659366 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-13c288aa-3d1c-4eff-a9f2-9cbc1c21f56f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:20.734213 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1095a26f-a7d8-41df-bce2-02e2ceab3fdd tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:20.742219 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1095a26f-a7d8-41df-bce2-02e2ceab3fdd tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1266 microversion: 2.1 time: 0.241186 Nov 08 16:21:20.742826 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 688/1366] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:20 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:21:21.101438 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-13c288aa-3d1c-4eff-a9f2-9cbc1c21f56f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:21.109233 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-13c288aa-3d1c-4eff-a9f2-9cbc1c21f56f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:21.110764 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-13c288aa-3d1c-4eff-a9f2-9cbc1c21f56f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:21.111932 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-13c288aa-3d1c-4eff-a9f2-9cbc1c21f56f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1723 microversion: 2.20 time: 0.466016 Nov 08 16:21:21.112785 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 679/1367] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:20 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1723 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:21.245353 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5b592915-176f-4d1e-93f0-a35b382deedf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:21.246322 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5b592915-176f-4d1e-93f0-a35b382deedf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:21.252584 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5b592915-176f-4d1e-93f0-a35b382deedf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:21.253025 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5b592915-176f-4d1e-93f0-a35b382deedf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:21.253865 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5b592915-176f-4d1e-93f0-a35b382deedf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:21.254292 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5b592915-176f-4d1e-93f0-a35b382deedf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:21.370060 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5b592915-176f-4d1e-93f0-a35b382deedf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.128642 Nov 08 16:21:21.370704 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 689/1368] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:21 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:21.759349 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8aad2da6-1f6a-480b-a05d-40bbef1fc5b7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:21.759943 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8aad2da6-1f6a-480b-a05d-40bbef1fc5b7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:21.766606 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8aad2da6-1f6a-480b-a05d-40bbef1fc5b7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:21.767045 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8aad2da6-1f6a-480b-a05d-40bbef1fc5b7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:21.767802 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8aad2da6-1f6a-480b-a05d-40bbef1fc5b7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:21.768223 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8aad2da6-1f6a-480b-a05d-40bbef1fc5b7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:21.899013 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8aad2da6-1f6a-480b-a05d-40bbef1fc5b7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:21.906179 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8aad2da6-1f6a-480b-a05d-40bbef1fc5b7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1266 microversion: 2.1 time: 0.150572 Nov 08 16:21:21.906734 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 680/1369] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:21 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:21:22.131866 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-62f860af-884e-40dd-9254-18d7703c3e37 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:22.132494 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-62f860af-884e-40dd-9254-18d7703c3e37 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:22.139325 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-62f860af-884e-40dd-9254-18d7703c3e37 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:22.139771 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-62f860af-884e-40dd-9254-18d7703c3e37 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:22.140540 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-62f860af-884e-40dd-9254-18d7703c3e37 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:22.140974 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-62f860af-884e-40dd-9254-18d7703c3e37 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:22.269063 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-62f860af-884e-40dd-9254-18d7703c3e37 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:22.277184 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-62f860af-884e-40dd-9254-18d7703c3e37 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:22.278764 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-62f860af-884e-40dd-9254-18d7703c3e37 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:22.279906 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-62f860af-884e-40dd-9254-18d7703c3e37 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1723 microversion: 2.20 time: 0.152756 Nov 08 16:21:22.280457 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 690/1370] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:22 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:22.381826 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ca380f85-ad93-4a17-adf6-f1f3e6b88255 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:22.382832 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ca380f85-ad93-4a17-adf6-f1f3e6b88255 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:22.388486 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ca380f85-ad93-4a17-adf6-f1f3e6b88255 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:22.388919 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ca380f85-ad93-4a17-adf6-f1f3e6b88255 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:22.389672 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ca380f85-ad93-4a17-adf6-f1f3e6b88255 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:22.390150 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ca380f85-ad93-4a17-adf6-f1f3e6b88255 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:22.477811 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ca380f85-ad93-4a17-adf6-f1f3e6b88255 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.100013 Nov 08 16:21:22.478434 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 681/1371] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:22 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:22.901743 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-a67c3ff6-d966-4bdb-89bb-a7f232f8da34 req-af01f1d6-400a-4c37-a59f-f07de1b6e828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f664b3dd-4458-4525-926a-1321ff188fdc", "name": "network-vif-plugged", "status": "completed", "tag": "ac61ca49-2eb1-4040-99b3-1fc5285b703f"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:22.903293 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:21:22.903293 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:21:22.910955 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-a67c3ff6-d966-4bdb-89bb-a7f232f8da34 req-af01f1d6-400a-4c37-a59f-f07de1b6e828 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:22.911401 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-a67c3ff6-d966-4bdb-89bb-a7f232f8da34 req-af01f1d6-400a-4c37-a59f-f07de1b6e828 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:22.922452 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-a67c3ff6-d966-4bdb-89bb-a7f232f8da34 req-af01f1d6-400a-4c37-a59f-f07de1b6e828 service nova] Creating event network-vif-plugged:ac61ca49-2eb1-4040-99b3-1fc5285b703f for instance f664b3dd-4458-4525-926a-1321ff188fdc on hv-cinder-81618 Nov 08 16:21:22.924267 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c1d6a9f4-af25-4ab5-b3ed-c5387c67fdf9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:22.925188 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c1d6a9f4-af25-4ab5-b3ed-c5387c67fdf9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:22.927611 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-a67c3ff6-d966-4bdb-89bb-a7f232f8da34 req-af01f1d6-400a-4c37-a59f-f07de1b6e828 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029720 Nov 08 16:21:22.928226 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 691/1372] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:21:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:21:22.933950 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c1d6a9f4-af25-4ab5-b3ed-c5387c67fdf9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:22.934474 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c1d6a9f4-af25-4ab5-b3ed-c5387c67fdf9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:22.935333 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c1d6a9f4-af25-4ab5-b3ed-c5387c67fdf9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:22.935830 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c1d6a9f4-af25-4ab5-b3ed-c5387c67fdf9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:23.070995 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c1d6a9f4-af25-4ab5-b3ed-c5387c67fdf9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:23.080058 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c1d6a9f4-af25-4ab5-b3ed-c5387c67fdf9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1266 microversion: 2.1 time: 0.160438 Nov 08 16:21:23.080936 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 682/1373] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:22 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:21:23.298878 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4a6b2e0b-2485-454c-8a8d-9873ab33c1b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:23.299509 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4a6b2e0b-2485-454c-8a8d-9873ab33c1b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:23.305467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a6b2e0b-2485-454c-8a8d-9873ab33c1b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:23.305958 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a6b2e0b-2485-454c-8a8d-9873ab33c1b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:23.306743 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a6b2e0b-2485-454c-8a8d-9873ab33c1b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:23.307183 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a6b2e0b-2485-454c-8a8d-9873ab33c1b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:23.432912 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4a6b2e0b-2485-454c-8a8d-9873ab33c1b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:23.440557 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4a6b2e0b-2485-454c-8a8d-9873ab33c1b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:23.442591 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4a6b2e0b-2485-454c-8a8d-9873ab33c1b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:23.443777 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4a6b2e0b-2485-454c-8a8d-9873ab33c1b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1723 microversion: 2.20 time: 0.149481 Nov 08 16:21:23.444381 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 692/1374] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:23 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:23.489647 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-32c1477e-de39-45d7-b8fe-772f98589a78 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:23.490574 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-32c1477e-de39-45d7-b8fe-772f98589a78 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:23.496928 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-32c1477e-de39-45d7-b8fe-772f98589a78 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:23.497363 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-32c1477e-de39-45d7-b8fe-772f98589a78 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:23.498149 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-32c1477e-de39-45d7-b8fe-772f98589a78 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:23.498576 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-32c1477e-de39-45d7-b8fe-772f98589a78 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:23.638239 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-32c1477e-de39-45d7-b8fe-772f98589a78 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.152647 Nov 08 16:21:23.639158 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 683/1375] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:23 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:24.096805 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c0c0ad23-582e-437b-8e3d-0f1f0c047085 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:24.097413 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c0c0ad23-582e-437b-8e3d-0f1f0c047085 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:24.103733 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c0c0ad23-582e-437b-8e3d-0f1f0c047085 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:24.104181 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c0c0ad23-582e-437b-8e3d-0f1f0c047085 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:24.104950 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c0c0ad23-582e-437b-8e3d-0f1f0c047085 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:24.105387 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c0c0ad23-582e-437b-8e3d-0f1f0c047085 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:24.238270 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c0c0ad23-582e-437b-8e3d-0f1f0c047085 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:24.245653 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c0c0ad23-582e-437b-8e3d-0f1f0c047085 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1266 microversion: 2.1 time: 0.152553 Nov 08 16:21:24.246236 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 693/1376] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:24 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:21:24.462246 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-95aa4660-b7f2-4e76-bc89-4f0146ceb9c8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:24.462877 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-95aa4660-b7f2-4e76-bc89-4f0146ceb9c8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:24.469667 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-95aa4660-b7f2-4e76-bc89-4f0146ceb9c8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:24.470140 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-95aa4660-b7f2-4e76-bc89-4f0146ceb9c8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:24.470891 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-95aa4660-b7f2-4e76-bc89-4f0146ceb9c8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:24.471316 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-95aa4660-b7f2-4e76-bc89-4f0146ceb9c8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:24.597579 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-95aa4660-b7f2-4e76-bc89-4f0146ceb9c8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:24.605269 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-95aa4660-b7f2-4e76-bc89-4f0146ceb9c8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:24.606843 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-95aa4660-b7f2-4e76-bc89-4f0146ceb9c8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:24.607999 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-95aa4660-b7f2-4e76-bc89-4f0146ceb9c8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1723 microversion: 2.20 time: 0.149824 Nov 08 16:21:24.608549 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 684/1377] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:24 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:24.649487 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-91cda5f1-bd69-4a9a-8e92-af15474b6846 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:24.650423 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-91cda5f1-bd69-4a9a-8e92-af15474b6846 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:24.656156 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-91cda5f1-bd69-4a9a-8e92-af15474b6846 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:24.656604 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-91cda5f1-bd69-4a9a-8e92-af15474b6846 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:24.657378 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-91cda5f1-bd69-4a9a-8e92-af15474b6846 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:24.657844 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-91cda5f1-bd69-4a9a-8e92-af15474b6846 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:24.734674 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-91cda5f1-bd69-4a9a-8e92-af15474b6846 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.088594 Nov 08 16:21:24.735245 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 694/1378] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:24 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:24.930660 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4252251a-330e-46cc-a88b-d670138f1015 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-265532524"}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:24.931198 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4252251a-330e-46cc-a88b-d670138f1015 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:24.937358 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4252251a-330e-46cc-a88b-d670138f1015 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:24.937834 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4252251a-330e-46cc-a88b-d670138f1015 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:24.938602 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4252251a-330e-46cc-a88b-d670138f1015 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:24.939027 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4252251a-330e-46cc-a88b-d670138f1015 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:25.063357 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.network.security_group_api [None req-4252251a-330e-46cc-a88b-d670138f1015 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Removing security group 1d27de4f-b93c-4054-9b9d-62a7c87a8620 from port 304e385a-c4e3-48f0-8723-230b5da69dc3 Nov 08 16:21:25.263726 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9d4bc1c8-6e2d-4b77-a177-0da7a364c870 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:25.264426 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9d4bc1c8-6e2d-4b77-a177-0da7a364c870 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:25.271842 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9d4bc1c8-6e2d-4b77-a177-0da7a364c870 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:25.272295 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9d4bc1c8-6e2d-4b77-a177-0da7a364c870 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:25.273075 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9d4bc1c8-6e2d-4b77-a177-0da7a364c870 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:25.273514 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9d4bc1c8-6e2d-4b77-a177-0da7a364c870 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:25.443529 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4252251a-330e-46cc-a88b-d670138f1015 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "POST /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912/action" status: 202 len: 0 microversion: 2.1 time: 0.516611 Nov 08 16:21:25.447121 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 685/1379] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:24 2021] POST /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:21:25.482196 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-1a282cd1-e55f-4088-8b3b-929e372b0e50 req-6727b1a1-3025-4e4c-ba4e-1918c5994f63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:25.484573 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:21:25.484573 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:21:25.504742 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-1a282cd1-e55f-4088-8b3b-929e372b0e50 req-6727b1a1-3025-4e4c-ba4e-1918c5994f63 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:25.505225 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-1a282cd1-e55f-4088-8b3b-929e372b0e50 req-6727b1a1-3025-4e4c-ba4e-1918c5994f63 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:25.532654 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-1a282cd1-e55f-4088-8b3b-929e372b0e50 req-6727b1a1-3025-4e4c-ba4e-1918c5994f63 service nova] Creating event network-changed:304e385a-c4e3-48f0-8723-230b5da69dc3 for instance 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 on hv-cinder-81618 Nov 08 16:21:25.544321 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-1a282cd1-e55f-4088-8b3b-929e372b0e50 req-6727b1a1-3025-4e4c-ba4e-1918c5994f63 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090571 Nov 08 16:21:25.547916 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 686/1380] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:21:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:21:25.558764 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-9d4bc1c8-6e2d-4b77-a177-0da7a364c870 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:25.566770 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9d4bc1c8-6e2d-4b77-a177-0da7a364c870 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1453 microversion: 2.1 time: 0.307088 Nov 08 16:21:25.567707 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 695/1381] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:25 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1453 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:21:25.583854 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-450bcc60-242f-48a9-809b-f6f3b61decb3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:25.584546 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-450bcc60-242f-48a9-809b-f6f3b61decb3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:25.591229 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-450bcc60-242f-48a9-809b-f6f3b61decb3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:25.592530 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-450bcc60-242f-48a9-809b-f6f3b61decb3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:25.593785 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-450bcc60-242f-48a9-809b-f6f3b61decb3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:25.594501 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-450bcc60-242f-48a9-809b-f6f3b61decb3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:25.627549 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0c5bdab2-2ced-4680-97f4-21eb394488a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:25.628514 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0c5bdab2-2ced-4680-97f4-21eb394488a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:25.638710 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0c5bdab2-2ced-4680-97f4-21eb394488a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:25.640276 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0c5bdab2-2ced-4680-97f4-21eb394488a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:25.641273 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0c5bdab2-2ced-4680-97f4-21eb394488a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:25.643362 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0c5bdab2-2ced-4680-97f4-21eb394488a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:25.991364 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0c5bdab2-2ced-4680-97f4-21eb394488a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:25.999901 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0c5bdab2-2ced-4680-97f4-21eb394488a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:26.001770 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0c5bdab2-2ced-4680-97f4-21eb394488a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:26.003444 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0c5bdab2-2ced-4680-97f4-21eb394488a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1723 microversion: 2.20 time: 0.380451 Nov 08 16:21:26.014161 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-450bcc60-242f-48a9-809b-f6f3b61decb3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:26.014867 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 696/1382] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:25 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1723 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:21:26.017505 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-450bcc60-242f-48a9-809b-f6f3b61decb3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1453 microversion: 2.1 time: 0.437818 Nov 08 16:21:26.019467 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 687/1383] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:25 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1453 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:21:26.020854 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bc36735a-5235-469e-9d46-577f98d637f7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:26.021845 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-bc36735a-5235-469e-9d46-577f98d637f7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:26.028010 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bc36735a-5235-469e-9d46-577f98d637f7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:26.028680 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bc36735a-5235-469e-9d46-577f98d637f7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:26.029615 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bc36735a-5235-469e-9d46-577f98d637f7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:26.030434 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bc36735a-5235-469e-9d46-577f98d637f7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:26.110931 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bc36735a-5235-469e-9d46-577f98d637f7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.092981 Nov 08 16:21:26.112172 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 697/1384] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:26 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:27.022045 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-53770596-641c-4a8a-bd7e-cc5f95347b76 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:27.022677 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-53770596-641c-4a8a-bd7e-cc5f95347b76 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:27.029015 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-53770596-641c-4a8a-bd7e-cc5f95347b76 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:27.029466 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-53770596-641c-4a8a-bd7e-cc5f95347b76 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:27.030275 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-53770596-641c-4a8a-bd7e-cc5f95347b76 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:27.030708 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-53770596-641c-4a8a-bd7e-cc5f95347b76 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:27.174331 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-53770596-641c-4a8a-bd7e-cc5f95347b76 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:27.183874 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-53770596-641c-4a8a-bd7e-cc5f95347b76 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:27.185693 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-53770596-641c-4a8a-bd7e-cc5f95347b76 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:27.187459 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-53770596-641c-4a8a-bd7e-cc5f95347b76 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1723 microversion: 2.20 time: 0.169741 Nov 08 16:21:27.198695 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 688/1385] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:27 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:27.212779 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-029c1749-9a7a-458f-9f33-f16ca659d8ad tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:27.213548 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-029c1749-9a7a-458f-9f33-f16ca659d8ad tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:27.220913 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-029c1749-9a7a-458f-9f33-f16ca659d8ad tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:27.221330 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-259c9a71-beea-4717-8e51-81e3d10c8078 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:27.221816 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-029c1749-9a7a-458f-9f33-f16ca659d8ad tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:27.223160 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-029c1749-9a7a-458f-9f33-f16ca659d8ad tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:27.223274 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-259c9a71-beea-4717-8e51-81e3d10c8078 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:27.223767 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-029c1749-9a7a-458f-9f33-f16ca659d8ad tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:27.235533 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-259c9a71-beea-4717-8e51-81e3d10c8078 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:27.236236 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-259c9a71-beea-4717-8e51-81e3d10c8078 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:27.237192 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-259c9a71-beea-4717-8e51-81e3d10c8078 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:27.238397 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-259c9a71-beea-4717-8e51-81e3d10c8078 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:27.313572 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.objects.instance [None req-029c1749-9a7a-458f-9f33-f16ca659d8ad tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lazy-loading 'services' on Instance uuid 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 {{(pid=115523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:21:27.317129 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-259c9a71-beea-4717-8e51-81e3d10c8078 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.197209 Nov 08 16:21:27.319821 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 698/1386] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:27 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:21:27.410236 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-029c1749-9a7a-458f-9f33-f16ca659d8ad tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "DELETE /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912/os-volume_attachments/a57e3ac2-4ff9-4836-a58c-b2fee6890b38" status: 202 len: 0 microversion: 2.1 time: 0.200909 Nov 08 16:21:27.414097 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 689/1387] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Nov 8 16:21:27 2021] DELETE /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912/os-volume_attachments/a57e3ac2-4ff9-4836-a58c-b2fee6890b38 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:21:27.421517 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b5877637-a946-4f93-bd85-0e53b66e90da tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:27.429736 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-2fb368f4-a54c-4ede-94a4-e98e118eae3f req-e69ed53c-f426-4563-91c3-6661c01b6c57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:27.431613 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:21:27.431613 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:21:27.434530 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b5877637-a946-4f93-bd85-0e53b66e90da tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:27.441583 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b5877637-a946-4f93-bd85-0e53b66e90da tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:27.442305 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b5877637-a946-4f93-bd85-0e53b66e90da tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:27.442546 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-2fb368f4-a54c-4ede-94a4-e98e118eae3f req-e69ed53c-f426-4563-91c3-6661c01b6c57 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:27.443177 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-2fb368f4-a54c-4ede-94a4-e98e118eae3f req-e69ed53c-f426-4563-91c3-6661c01b6c57 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:27.443304 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b5877637-a946-4f93-bd85-0e53b66e90da tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:27.445052 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b5877637-a946-4f93-bd85-0e53b66e90da tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:27.455322 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-2fb368f4-a54c-4ede-94a4-e98e118eae3f req-e69ed53c-f426-4563-91c3-6661c01b6c57 service nova] Creating event network-changed:304e385a-c4e3-48f0-8723-230b5da69dc3 for instance 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 on hv-cinder-81618 Nov 08 16:21:27.461542 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-2fb368f4-a54c-4ede-94a4-e98e118eae3f req-e69ed53c-f426-4563-91c3-6661c01b6c57 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142337 Nov 08 16:21:27.462749 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 699/1388] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:21:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:21:27.492022 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b5877637-a946-4f93-bd85-0e53b66e90da tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074620 Nov 08 16:21:27.492734 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 690/1389] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:21:27 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:21:28.207891 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-00a8d001-ffb8-4d78-9901-60a30bb2bec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:28.208606 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-00a8d001-ffb8-4d78-9901-60a30bb2bec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:28.215554 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-00a8d001-ffb8-4d78-9901-60a30bb2bec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:28.216008 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-00a8d001-ffb8-4d78-9901-60a30bb2bec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:28.216799 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-00a8d001-ffb8-4d78-9901-60a30bb2bec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:28.217220 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-00a8d001-ffb8-4d78-9901-60a30bb2bec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:28.338215 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-2ac7638a-217d-44ac-8bf8-c14be6249037 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:28.339883 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-2ac7638a-217d-44ac-8bf8-c14be6249037 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:28.351989 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2ac7638a-217d-44ac-8bf8-c14be6249037 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:28.354383 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2ac7638a-217d-44ac-8bf8-c14be6249037 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:28.355268 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2ac7638a-217d-44ac-8bf8-c14be6249037 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:28.355822 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2ac7638a-217d-44ac-8bf8-c14be6249037 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:28.369928 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-00a8d001-ffb8-4d78-9901-60a30bb2bec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:28.379486 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-00a8d001-ffb8-4d78-9901-60a30bb2bec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:28.381087 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-00a8d001-ffb8-4d78-9901-60a30bb2bec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:28.382408 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-00a8d001-ffb8-4d78-9901-60a30bb2bec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1723 microversion: 2.20 time: 0.180286 Nov 08 16:21:28.383042 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 700/1390] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:28 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:28.449217 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-2ac7638a-217d-44ac-8bf8-c14be6249037 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.122581 Nov 08 16:21:28.450043 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 691/1391] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:28 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:28.506889 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-dcbe0005-e83a-408b-aec0-a55e4e539065 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:28.507812 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-dcbe0005-e83a-408b-aec0-a55e4e539065 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:28.525817 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dcbe0005-e83a-408b-aec0-a55e4e539065 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:28.526584 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dcbe0005-e83a-408b-aec0-a55e4e539065 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:28.527459 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dcbe0005-e83a-408b-aec0-a55e4e539065 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:28.528044 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dcbe0005-e83a-408b-aec0-a55e4e539065 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:28.558739 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-dcbe0005-e83a-408b-aec0-a55e4e539065 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056873 Nov 08 16:21:28.559203 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 701/1392] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:21:28 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:21:28.569615 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4c1b7875-0d48-49f0-b65a-12c579132f74 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:28.570220 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4c1b7875-0d48-49f0-b65a-12c579132f74 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:28.577026 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4c1b7875-0d48-49f0-b65a-12c579132f74 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:28.577468 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4c1b7875-0d48-49f0-b65a-12c579132f74 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:28.578273 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4c1b7875-0d48-49f0-b65a-12c579132f74 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:28.578707 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4c1b7875-0d48-49f0-b65a-12c579132f74 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:28.651680 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-4c1b7875-0d48-49f0-b65a-12c579132f74 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] HTTP exception thrown: Instance 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 is not attached to volume a57e3ac2-4ff9-4836-a58c-b2fee6890b38 Nov 08 16:21:28.652286 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4c1b7875-0d48-49f0-b65a-12c579132f74 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Returning 404 to user: Instance 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 is not attached to volume a57e3ac2-4ff9-4836-a58c-b2fee6890b38 {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:21:28.653138 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4c1b7875-0d48-49f0-b65a-12c579132f74 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "DELETE /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912/os-volume_attachments/a57e3ac2-4ff9-4836-a58c-b2fee6890b38" status: 404 len: 154 microversion: 2.1 time: 0.087859 Nov 08 16:21:28.653687 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 692/1393] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Nov 8 16:21:28 2021] DELETE /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912/os-volume_attachments/a57e3ac2-4ff9-4836-a58c-b2fee6890b38 => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 08 16:21:29.400729 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0c866b53-60d8-48fa-a3fe-f27c268293e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:29.401404 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0c866b53-60d8-48fa-a3fe-f27c268293e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:29.407936 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0c866b53-60d8-48fa-a3fe-f27c268293e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:29.408388 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0c866b53-60d8-48fa-a3fe-f27c268293e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:29.409173 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0c866b53-60d8-48fa-a3fe-f27c268293e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:29.409605 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0c866b53-60d8-48fa-a3fe-f27c268293e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:29.461331 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-883ee7ee-72ab-4894-8ebd-5782911700d4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:29.462594 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-883ee7ee-72ab-4894-8ebd-5782911700d4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:29.470133 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-883ee7ee-72ab-4894-8ebd-5782911700d4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:29.470843 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-883ee7ee-72ab-4894-8ebd-5782911700d4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:29.471681 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-883ee7ee-72ab-4894-8ebd-5782911700d4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:29.472360 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-883ee7ee-72ab-4894-8ebd-5782911700d4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:29.536949 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-883ee7ee-72ab-4894-8ebd-5782911700d4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.079813 Nov 08 16:21:29.537955 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 693/1394] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:29 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:29.544343 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-a288ed35-5d3e-4ba6-a4b0-138a82243cd2 req-cc86cdc0-7bcb-4dae-bd74-e6809277300d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f664b3dd-4458-4525-926a-1321ff188fdc", "tag": "ac61ca49-2eb1-4040-99b3-1fc5285b703f"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:29.546441 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:21:29.546441 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:21:29.549251 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0c866b53-60d8-48fa-a3fe-f27c268293e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:29.557952 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0c866b53-60d8-48fa-a3fe-f27c268293e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:29.559458 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0c866b53-60d8-48fa-a3fe-f27c268293e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:29.560621 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0c866b53-60d8-48fa-a3fe-f27c268293e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1723 microversion: 2.20 time: 0.163713 Nov 08 16:21:29.560759 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-a288ed35-5d3e-4ba6-a4b0-138a82243cd2 req-cc86cdc0-7bcb-4dae-bd74-e6809277300d service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:29.561200 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 702/1395] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:29 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:29.561384 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-a288ed35-5d3e-4ba6-a4b0-138a82243cd2 req-cc86cdc0-7bcb-4dae-bd74-e6809277300d service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:29.573316 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-a288ed35-5d3e-4ba6-a4b0-138a82243cd2 req-cc86cdc0-7bcb-4dae-bd74-e6809277300d service nova] Creating event network-changed:ac61ca49-2eb1-4040-99b3-1fc5285b703f for instance f664b3dd-4458-4525-926a-1321ff188fdc on hv-cinder-81618 Nov 08 16:21:29.578995 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-a288ed35-5d3e-4ba6-a4b0-138a82243cd2 req-cc86cdc0-7bcb-4dae-bd74-e6809277300d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039652 Nov 08 16:21:29.579871 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 694/1396] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:21:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:21:29.782946 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-590bc668-0074-445c-b66b-cbd8ddf293bf tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:29.783441 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-590bc668-0074-445c-b66b-cbd8ddf293bf tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:29.789932 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-590bc668-0074-445c-b66b-cbd8ddf293bf tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:29.790379 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-590bc668-0074-445c-b66b-cbd8ddf293bf tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:29.791147 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-590bc668-0074-445c-b66b-cbd8ddf293bf tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:29.791578 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-590bc668-0074-445c-b66b-cbd8ddf293bf tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:29.815058 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-590bc668-0074-445c-b66b-cbd8ddf293bf tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Going to try to terminate instance {{(pid=115524) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:21:29.891742 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-590bc668-0074-445c-b66b-cbd8ddf293bf tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "DELETE /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 204 len: 0 microversion: 2.1 time: 0.112159 Nov 08 16:21:29.892326 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 703/1397] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:21:29 2021] DELETE /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:21:29.902500 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8803c8fd-5a37-40c3-881a-c2c882354bb1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:29.903191 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8803c8fd-5a37-40c3-881a-c2c882354bb1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:29.910797 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8803c8fd-5a37-40c3-881a-c2c882354bb1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:29.911243 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8803c8fd-5a37-40c3-881a-c2c882354bb1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:29.912014 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8803c8fd-5a37-40c3-881a-c2c882354bb1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:29.912433 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8803c8fd-5a37-40c3-881a-c2c882354bb1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:30.146457 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-8803c8fd-5a37-40c3-881a-c2c882354bb1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:30.153847 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8803c8fd-5a37-40c3-881a-c2c882354bb1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1553 microversion: 2.1 time: 0.256406 Nov 08 16:21:30.154538 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 695/1398] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:29 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1553 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:21:30.549567 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7b86cf80-61de-4736-87c5-709c9749bb58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:30.551091 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7b86cf80-61de-4736-87c5-709c9749bb58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:30.557266 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7b86cf80-61de-4736-87c5-709c9749bb58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:30.557734 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7b86cf80-61de-4736-87c5-709c9749bb58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:30.558521 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7b86cf80-61de-4736-87c5-709c9749bb58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:30.558951 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7b86cf80-61de-4736-87c5-709c9749bb58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:30.578055 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1037e4db-156e-401a-b5c0-e27e759621f8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:30.578790 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1037e4db-156e-401a-b5c0-e27e759621f8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:30.585028 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1037e4db-156e-401a-b5c0-e27e759621f8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:30.585471 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1037e4db-156e-401a-b5c0-e27e759621f8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:30.586319 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1037e4db-156e-401a-b5c0-e27e759621f8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:30.586814 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1037e4db-156e-401a-b5c0-e27e759621f8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:30.631159 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7b86cf80-61de-4736-87c5-709c9749bb58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.085487 Nov 08 16:21:30.631966 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 704/1399] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:30 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:30.715268 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1037e4db-156e-401a-b5c0-e27e759621f8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:30.723292 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1037e4db-156e-401a-b5c0-e27e759621f8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:30.724783 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1037e4db-156e-401a-b5c0-e27e759621f8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:30.726033 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1037e4db-156e-401a-b5c0-e27e759621f8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1723 microversion: 2.20 time: 0.151525 Nov 08 16:21:30.726584 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 696/1400] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:30 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:21:31.170726 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-13a20cef-87d9-4783-b580-b5a9bcc7e079 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:31.171421 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-13a20cef-87d9-4783-b580-b5a9bcc7e079 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:31.178526 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-13a20cef-87d9-4783-b580-b5a9bcc7e079 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:31.178909 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-13a20cef-87d9-4783-b580-b5a9bcc7e079 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:31.179668 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-13a20cef-87d9-4783-b580-b5a9bcc7e079 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:31.180116 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-13a20cef-87d9-4783-b580-b5a9bcc7e079 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:31.308572 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-13a20cef-87d9-4783-b580-b5a9bcc7e079 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:31.316310 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-13a20cef-87d9-4783-b580-b5a9bcc7e079 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1553 microversion: 2.1 time: 0.149722 Nov 08 16:21:31.316866 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 705/1401] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:31 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:21:31.642531 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-fa72b35d-1204-4602-aa69-efa0db602930 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:31.643483 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fa72b35d-1204-4602-aa69-efa0db602930 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:31.650279 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fa72b35d-1204-4602-aa69-efa0db602930 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:31.650715 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fa72b35d-1204-4602-aa69-efa0db602930 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:31.651468 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fa72b35d-1204-4602-aa69-efa0db602930 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:31.651889 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fa72b35d-1204-4602-aa69-efa0db602930 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:31.744767 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e991ff17-37a8-464a-90d2-8a87f627dc17 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:31.745379 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e991ff17-37a8-464a-90d2-8a87f627dc17 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:31.751722 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e991ff17-37a8-464a-90d2-8a87f627dc17 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:31.752169 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e991ff17-37a8-464a-90d2-8a87f627dc17 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:31.752939 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e991ff17-37a8-464a-90d2-8a87f627dc17 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:31.753401 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e991ff17-37a8-464a-90d2-8a87f627dc17 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:31.879545 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e991ff17-37a8-464a-90d2-8a87f627dc17 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:31.887174 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e991ff17-37a8-464a-90d2-8a87f627dc17 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:31.888681 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e991ff17-37a8-464a-90d2-8a87f627dc17 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:31.889870 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e991ff17-37a8-464a-90d2-8a87f627dc17 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1723 microversion: 2.20 time: 0.149026 Nov 08 16:21:31.890432 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 706/1402] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:31 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:21:32.332426 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3c97c6a7-89cd-49b4-bda1-73f146fe7acb tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:32.333060 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3c97c6a7-89cd-49b4-bda1-73f146fe7acb tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:32.339381 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3c97c6a7-89cd-49b4-bda1-73f146fe7acb tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:32.339771 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3c97c6a7-89cd-49b4-bda1-73f146fe7acb tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:32.340545 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3c97c6a7-89cd-49b4-bda1-73f146fe7acb tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:32.340971 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3c97c6a7-89cd-49b4-bda1-73f146fe7acb tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:32.464826 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-3c97c6a7-89cd-49b4-bda1-73f146fe7acb tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:32.472549 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3c97c6a7-89cd-49b4-bda1-73f146fe7acb tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1553 microversion: 2.1 time: 0.143307 Nov 08 16:21:32.473121 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 707/1403] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:32 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1553 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:21:32.477252 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-fa72b35d-1204-4602-aa69-efa0db602930 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.838168 Nov 08 16:21:32.477964 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 697/1404] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:31 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:32.908122 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c6913bfb-1edc-4144-8c8d-e70b9f2fa242 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:32.908795 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c6913bfb-1edc-4144-8c8d-e70b9f2fa242 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:32.915323 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c6913bfb-1edc-4144-8c8d-e70b9f2fa242 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:32.915766 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c6913bfb-1edc-4144-8c8d-e70b9f2fa242 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:32.916541 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c6913bfb-1edc-4144-8c8d-e70b9f2fa242 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:32.916973 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c6913bfb-1edc-4144-8c8d-e70b9f2fa242 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:33.099294 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c6913bfb-1edc-4144-8c8d-e70b9f2fa242 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:33.121374 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c6913bfb-1edc-4144-8c8d-e70b9f2fa242 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:33.122935 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c6913bfb-1edc-4144-8c8d-e70b9f2fa242 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:33.124083 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c6913bfb-1edc-4144-8c8d-e70b9f2fa242 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1744 microversion: 2.20 time: 0.219736 Nov 08 16:21:33.124645 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 708/1405] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:32 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1744 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:33.184750 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-74c16854-0514-45f5-b22d-119ee604539f req-de1cf9bd-b153-4307-832a-e2b7773b8c46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "name": "network-vif-deleted", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:33.186231 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:21:33.186231 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:21:33.194958 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-74c16854-0514-45f5-b22d-119ee604539f req-de1cf9bd-b153-4307-832a-e2b7773b8c46 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:33.195475 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-74c16854-0514-45f5-b22d-119ee604539f req-de1cf9bd-b153-4307-832a-e2b7773b8c46 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:33.207784 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-74c16854-0514-45f5-b22d-119ee604539f req-de1cf9bd-b153-4307-832a-e2b7773b8c46 service nova] Creating event network-vif-deleted:304e385a-c4e3-48f0-8723-230b5da69dc3 for instance 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 on hv-cinder-81618 Nov 08 16:21:33.212505 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-74c16854-0514-45f5-b22d-119ee604539f req-de1cf9bd-b153-4307-832a-e2b7773b8c46 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031399 Nov 08 16:21:33.213194 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 698/1406] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:21:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:21:33.489625 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-39424c19-71ae-4823-944b-695648536d04 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:33.495494 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-39424c19-71ae-4823-944b-695648536d04 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:33.495852 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a816f484-a083-40d1-9d21-d6aa7670ae89 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:33.496635 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a816f484-a083-40d1-9d21-d6aa7670ae89 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:33.502093 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-39424c19-71ae-4823-944b-695648536d04 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:33.502547 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-39424c19-71ae-4823-944b-695648536d04 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:33.503274 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a816f484-a083-40d1-9d21-d6aa7670ae89 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:33.503444 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-39424c19-71ae-4823-944b-695648536d04 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:33.503766 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-39424c19-71ae-4823-944b-695648536d04 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:33.504196 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a816f484-a083-40d1-9d21-d6aa7670ae89 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:33.505133 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a816f484-a083-40d1-9d21-d6aa7670ae89 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:33.505557 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a816f484-a083-40d1-9d21-d6aa7670ae89 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:33.543581 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a816f484-a083-40d1-9d21-d6aa7670ae89 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:33.544037 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a816f484-a083-40d1-9d21-d6aa7670ae89 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:33.544493 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.objects.instance [None req-a816f484-a083-40d1-9d21-d6aa7670ae89 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lazy-loading 'fault' on Instance uuid 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 {{(pid=115523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:21:33.571405 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-39424c19-71ae-4823-944b-695648536d04 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.085311 Nov 08 16:21:33.572706 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 709/1407] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:33 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:21:33.601669 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a816f484-a083-40d1-9d21-d6aa7670ae89 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af064e4b18c0451da237604a7ecae5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:33.609608 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a816f484-a083-40d1-9d21-d6aa7670ae89 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 200 len: 1348 microversion: 2.1 time: 0.118436 Nov 08 16:21:33.610524 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 699/1408] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:33 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 1348 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:21:34.143298 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c12a5877-97d6-4f3e-8861-c7442410533a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:34.144554 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c12a5877-97d6-4f3e-8861-c7442410533a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:34.151366 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c12a5877-97d6-4f3e-8861-c7442410533a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:34.151810 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c12a5877-97d6-4f3e-8861-c7442410533a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:34.152576 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c12a5877-97d6-4f3e-8861-c7442410533a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:34.153007 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c12a5877-97d6-4f3e-8861-c7442410533a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:34.281596 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c12a5877-97d6-4f3e-8861-c7442410533a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:34.290388 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c12a5877-97d6-4f3e-8861-c7442410533a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:34.292025 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c12a5877-97d6-4f3e-8861-c7442410533a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:34.293173 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c12a5877-97d6-4f3e-8861-c7442410533a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1744 microversion: 2.20 time: 0.153976 Nov 08 16:21:34.293731 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 710/1409] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:34 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:34.583431 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-54c86dc5-678f-4427-9a80-24d6420b8a17 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:34.584345 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-54c86dc5-678f-4427-9a80-24d6420b8a17 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:34.590621 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-54c86dc5-678f-4427-9a80-24d6420b8a17 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:34.591066 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-54c86dc5-678f-4427-9a80-24d6420b8a17 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:34.591836 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-54c86dc5-678f-4427-9a80-24d6420b8a17 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:34.592265 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-54c86dc5-678f-4427-9a80-24d6420b8a17 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:34.626785 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-10f1613b-867b-4591-99f0-018ca7be798e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:34.627391 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-10f1613b-867b-4591-99f0-018ca7be798e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] [instance: 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:34.634098 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-10f1613b-867b-4591-99f0-018ca7be798e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:34.634544 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-10f1613b-867b-4591-99f0-018ca7be798e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:34.635312 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-10f1613b-867b-4591-99f0-018ca7be798e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:34.635743 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-10f1613b-867b-4591-99f0-018ca7be798e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:34.649168 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-10f1613b-867b-4591-99f0-018ca7be798e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] HTTP exception thrown: Instance 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 could not be found. Nov 08 16:21:34.649775 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-10f1613b-867b-4591-99f0-018ca7be798e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Returning 404 to user: Instance 4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:21:34.650588 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-10f1613b-867b-4591-99f0-018ca7be798e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912" status: 404 len: 111 microversion: 2.1 time: 0.027489 Nov 08 16:21:34.651102 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 711/1410] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:21:34 2021] GET /compute/v2.1/servers/4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 08 16:21:34.658366 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-25e015ba-89b9-40d2-b50e-1d22743b1711 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling method '.version_select at 0x7f8c077319d0>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:34.664882 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-54c86dc5-678f-4427-9a80-24d6420b8a17 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.085442 Nov 08 16:21:34.669747 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 700/1411] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:34 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:34.678297 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-25e015ba-89b9-40d2-b50e-1d22743b1711 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-659795178" status: 202 len: 0 microversion: 2.1 time: 0.023045 Nov 08 16:21:34.678870 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 712/1412] 10.222.0.37 () {58 vars in 1268 bytes} [Mon Nov 8 16:21:34 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-659795178 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:21:35.311366 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c84f9af1-6227-4598-acfc-e84aba3a353c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:35.312118 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c84f9af1-6227-4598-acfc-e84aba3a353c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:35.318860 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c84f9af1-6227-4598-acfc-e84aba3a353c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:35.319302 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c84f9af1-6227-4598-acfc-e84aba3a353c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:35.320070 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c84f9af1-6227-4598-acfc-e84aba3a353c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:35.320494 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c84f9af1-6227-4598-acfc-e84aba3a353c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:35.556549 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c84f9af1-6227-4598-acfc-e84aba3a353c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:35.564144 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c84f9af1-6227-4598-acfc-e84aba3a353c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:35.566430 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c84f9af1-6227-4598-acfc-e84aba3a353c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:35.567600 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c84f9af1-6227-4598-acfc-e84aba3a353c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1744 microversion: 2.20 time: 0.260324 Nov 08 16:21:35.568146 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 701/1413] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:35 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1744 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:35.677616 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3166c6e3-e61d-439e-aedc-5bd567f1b572 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:35.678566 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3166c6e3-e61d-439e-aedc-5bd567f1b572 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:35.685052 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3166c6e3-e61d-439e-aedc-5bd567f1b572 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:35.685502 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3166c6e3-e61d-439e-aedc-5bd567f1b572 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:35.686317 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3166c6e3-e61d-439e-aedc-5bd567f1b572 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:35.686741 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3166c6e3-e61d-439e-aedc-5bd567f1b572 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:35.747462 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3166c6e3-e61d-439e-aedc-5bd567f1b572 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.074594 Nov 08 16:21:35.748128 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 713/1414] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:35 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:36.585176 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-bcf26f87-b000-4993-a80d-309c3c07e3f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:36.585801 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-bcf26f87-b000-4993-a80d-309c3c07e3f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:36.592470 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bcf26f87-b000-4993-a80d-309c3c07e3f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:36.592998 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bcf26f87-b000-4993-a80d-309c3c07e3f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:36.594004 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bcf26f87-b000-4993-a80d-309c3c07e3f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:36.594510 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bcf26f87-b000-4993-a80d-309c3c07e3f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:36.759859 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5729fc16-306b-4138-bac4-b78d981d6aee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:36.760998 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5729fc16-306b-4138-bac4-b78d981d6aee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:36.768002 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5729fc16-306b-4138-bac4-b78d981d6aee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:36.768473 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5729fc16-306b-4138-bac4-b78d981d6aee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:36.769465 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5729fc16-306b-4138-bac4-b78d981d6aee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:36.769958 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5729fc16-306b-4138-bac4-b78d981d6aee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:36.827517 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-bcf26f87-b000-4993-a80d-309c3c07e3f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:36.835361 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-bcf26f87-b000-4993-a80d-309c3c07e3f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:36.836939 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-bcf26f87-b000-4993-a80d-309c3c07e3f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:36.838206 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-bcf26f87-b000-4993-a80d-309c3c07e3f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1744 microversion: 2.20 time: 0.257294 Nov 08 16:21:36.838859 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 702/1415] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:36 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1744 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:36.844639 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5729fc16-306b-4138-bac4-b78d981d6aee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.088702 Nov 08 16:21:36.846212 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 714/1416] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:36 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:21:37.025599 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-ccc3d4f3-5b44-4c5c-87c0-f8aea8eff197 req-be5d7027-8f54-4a72-84f2-65a90bb0b3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "name": "network-vif-plugged", "status": "completed", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:37.027624 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:21:37.027624 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:21:37.036504 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-ccc3d4f3-5b44-4c5c-87c0-f8aea8eff197 req-be5d7027-8f54-4a72-84f2-65a90bb0b3a5 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:37.037096 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-ccc3d4f3-5b44-4c5c-87c0-f8aea8eff197 req-be5d7027-8f54-4a72-84f2-65a90bb0b3a5 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:37.050221 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-ccc3d4f3-5b44-4c5c-87c0-f8aea8eff197 req-be5d7027-8f54-4a72-84f2-65a90bb0b3a5 service nova] Creating event network-vif-plugged:b3094cea-72ef-41cf-ac88-a6d678f0fb09 for instance f0c4ded0-3419-458b-ab12-da310a2b2fd7 on hv-cinder-81618 Nov 08 16:21:37.055352 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-ccc3d4f3-5b44-4c5c-87c0-f8aea8eff197 req-be5d7027-8f54-4a72-84f2-65a90bb0b3a5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033913 Nov 08 16:21:37.055930 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 703/1417] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:21:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:21:37.857646 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f792511f-3d3b-4e6e-a581-fcd7780f4e01 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:37.858234 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-768b247d-7e82-45c6-96cf-dbcd9e1a0ea2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:37.858611 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f792511f-3d3b-4e6e-a581-fcd7780f4e01 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:37.858715 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-768b247d-7e82-45c6-96cf-dbcd9e1a0ea2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:37.865127 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-768b247d-7e82-45c6-96cf-dbcd9e1a0ea2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:37.865498 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-768b247d-7e82-45c6-96cf-dbcd9e1a0ea2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:37.865733 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f792511f-3d3b-4e6e-a581-fcd7780f4e01 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:37.866175 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f792511f-3d3b-4e6e-a581-fcd7780f4e01 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:37.866290 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-768b247d-7e82-45c6-96cf-dbcd9e1a0ea2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:37.866964 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-768b247d-7e82-45c6-96cf-dbcd9e1a0ea2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:37.867202 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f792511f-3d3b-4e6e-a581-fcd7780f4e01 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:37.868126 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f792511f-3d3b-4e6e-a581-fcd7780f4e01 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:37.938647 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-768b247d-7e82-45c6-96cf-dbcd9e1a0ea2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.084689 Nov 08 16:21:37.940125 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 704/1418] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:37 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:38.104636 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f792511f-3d3b-4e6e-a581-fcd7780f4e01 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:38.126982 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f792511f-3d3b-4e6e-a581-fcd7780f4e01 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:38.128991 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f792511f-3d3b-4e6e-a581-fcd7780f4e01 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:38.130192 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f792511f-3d3b-4e6e-a581-fcd7780f4e01 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1744 microversion: 2.20 time: 0.276612 Nov 08 16:21:38.130741 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 715/1419] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:37 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1744 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:38.951895 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f0c50fd3-b9da-40d9-b50c-61df13cc3026 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:38.952947 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f0c50fd3-b9da-40d9-b50c-61df13cc3026 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:38.960304 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f0c50fd3-b9da-40d9-b50c-61df13cc3026 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:38.960755 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f0c50fd3-b9da-40d9-b50c-61df13cc3026 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:38.961645 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f0c50fd3-b9da-40d9-b50c-61df13cc3026 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:38.962262 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f0c50fd3-b9da-40d9-b50c-61df13cc3026 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:39.034426 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f0c50fd3-b9da-40d9-b50c-61df13cc3026 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.086006 Nov 08 16:21:39.035005 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 705/1420] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:38 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:39.149385 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7adcd33e-c919-45a6-9154-67025f698fb5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:39.150167 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-7adcd33e-c919-45a6-9154-67025f698fb5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:39.161773 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7adcd33e-c919-45a6-9154-67025f698fb5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:39.166366 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7adcd33e-c919-45a6-9154-67025f698fb5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:39.167325 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7adcd33e-c919-45a6-9154-67025f698fb5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:39.168470 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-7adcd33e-c919-45a6-9154-67025f698fb5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:39.342063 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7adcd33e-c919-45a6-9154-67025f698fb5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:39.352221 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7adcd33e-c919-45a6-9154-67025f698fb5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:39.354022 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-7adcd33e-c919-45a6-9154-67025f698fb5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:39.356466 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7adcd33e-c919-45a6-9154-67025f698fb5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1739 microversion: 2.20 time: 0.211536 Nov 08 16:21:39.357197 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 716/1421] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:39 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:40.047520 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-7c94b506-eac2-4e02-acb3-be7026923f3d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:40.050039 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-7c94b506-eac2-4e02-acb3-be7026923f3d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:40.059748 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7c94b506-eac2-4e02-acb3-be7026923f3d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:40.060574 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7c94b506-eac2-4e02-acb3-be7026923f3d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:40.062164 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7c94b506-eac2-4e02-acb3-be7026923f3d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:40.062857 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7c94b506-eac2-4e02-acb3-be7026923f3d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:40.151686 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-7c94b506-eac2-4e02-acb3-be7026923f3d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.108242 Nov 08 16:21:40.153292 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 706/1422] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:40 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:40.376076 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a45dc6bc-7a65-4413-b71e-d81b5d5b5ba0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:40.377613 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a45dc6bc-7a65-4413-b71e-d81b5d5b5ba0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:40.385151 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a45dc6bc-7a65-4413-b71e-d81b5d5b5ba0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:40.385960 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a45dc6bc-7a65-4413-b71e-d81b5d5b5ba0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:40.391239 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a45dc6bc-7a65-4413-b71e-d81b5d5b5ba0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:40.391976 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a45dc6bc-7a65-4413-b71e-d81b5d5b5ba0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:40.562619 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a45dc6bc-7a65-4413-b71e-d81b5d5b5ba0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:40.573191 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a45dc6bc-7a65-4413-b71e-d81b5d5b5ba0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:40.578826 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a45dc6bc-7a65-4413-b71e-d81b5d5b5ba0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:40.582360 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a45dc6bc-7a65-4413-b71e-d81b5d5b5ba0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1739 microversion: 2.20 time: 0.210670 Nov 08 16:21:40.600103 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 717/1423] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:40 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:41.166849 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-bca0df13-375e-455e-952a-a1f0ce774877 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:41.169122 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-bca0df13-375e-455e-952a-a1f0ce774877 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:41.178168 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bca0df13-375e-455e-952a-a1f0ce774877 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:41.178815 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bca0df13-375e-455e-952a-a1f0ce774877 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:41.180126 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bca0df13-375e-455e-952a-a1f0ce774877 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:41.181861 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bca0df13-375e-455e-952a-a1f0ce774877 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:41.255069 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-bca0df13-375e-455e-952a-a1f0ce774877 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.093093 Nov 08 16:21:41.256518 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 707/1424] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:41 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:41.604195 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-dcf9f945-74f3-42fc-89ab-93d897884e9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:41.605395 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-dcf9f945-74f3-42fc-89ab-93d897884e9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:41.612150 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dcf9f945-74f3-42fc-89ab-93d897884e9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:41.612863 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dcf9f945-74f3-42fc-89ab-93d897884e9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:41.613941 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dcf9f945-74f3-42fc-89ab-93d897884e9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:41.614605 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dcf9f945-74f3-42fc-89ab-93d897884e9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:41.809133 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-dcf9f945-74f3-42fc-89ab-93d897884e9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:41.820215 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-dcf9f945-74f3-42fc-89ab-93d897884e9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:41.822259 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-dcf9f945-74f3-42fc-89ab-93d897884e9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:41.823901 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-dcf9f945-74f3-42fc-89ab-93d897884e9c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1739 microversion: 2.20 time: 0.223520 Nov 08 16:21:41.834789 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 718/1425] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:41 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:42.273583 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-103f5354-22fb-4df0-b53b-6aa4fa5e03fc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:42.275520 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-103f5354-22fb-4df0-b53b-6aa4fa5e03fc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:42.284319 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-103f5354-22fb-4df0-b53b-6aa4fa5e03fc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:42.285102 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-103f5354-22fb-4df0-b53b-6aa4fa5e03fc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:42.286263 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-103f5354-22fb-4df0-b53b-6aa4fa5e03fc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:42.287375 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-103f5354-22fb-4df0-b53b-6aa4fa5e03fc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:42.391233 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-103f5354-22fb-4df0-b53b-6aa4fa5e03fc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.126391 Nov 08 16:21:42.392310 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 708/1426] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:42 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:42.849172 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-95c62a63-e4cb-4b23-a4a5-265b651b64b8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:42.852178 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-95c62a63-e4cb-4b23-a4a5-265b651b64b8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:42.865355 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-95c62a63-e4cb-4b23-a4a5-265b651b64b8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:42.866735 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-95c62a63-e4cb-4b23-a4a5-265b651b64b8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:42.867961 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-95c62a63-e4cb-4b23-a4a5-265b651b64b8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:42.868557 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-95c62a63-e4cb-4b23-a4a5-265b651b64b8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:43.184263 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-95c62a63-e4cb-4b23-a4a5-265b651b64b8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:43.199804 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-95c62a63-e4cb-4b23-a4a5-265b651b64b8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:43.203370 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-95c62a63-e4cb-4b23-a4a5-265b651b64b8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:43.204795 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-95c62a63-e4cb-4b23-a4a5-265b651b64b8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1739 microversion: 2.20 time: 0.365864 Nov 08 16:21:43.207308 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 719/1427] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:42 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1739 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:43.404846 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-763e7644-1620-4101-a417-bd08ac48521d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:43.406094 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-763e7644-1620-4101-a417-bd08ac48521d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:43.416082 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-763e7644-1620-4101-a417-bd08ac48521d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:43.416533 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-763e7644-1620-4101-a417-bd08ac48521d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:43.417448 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-763e7644-1620-4101-a417-bd08ac48521d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:43.417920 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-763e7644-1620-4101-a417-bd08ac48521d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:43.504499 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-763e7644-1620-4101-a417-bd08ac48521d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.102545 Nov 08 16:21:43.510634 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 709/1428] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:43 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:44.228080 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e6fe2fba-923e-4d40-ae8d-0eddcc64a54b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:44.229459 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e6fe2fba-923e-4d40-ae8d-0eddcc64a54b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:44.236745 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e6fe2fba-923e-4d40-ae8d-0eddcc64a54b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:44.237491 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e6fe2fba-923e-4d40-ae8d-0eddcc64a54b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:44.238763 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e6fe2fba-923e-4d40-ae8d-0eddcc64a54b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:44.239548 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e6fe2fba-923e-4d40-ae8d-0eddcc64a54b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:44.397273 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e6fe2fba-923e-4d40-ae8d-0eddcc64a54b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:44.405672 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e6fe2fba-923e-4d40-ae8d-0eddcc64a54b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:44.407522 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e6fe2fba-923e-4d40-ae8d-0eddcc64a54b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:44.409630 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e6fe2fba-923e-4d40-ae8d-0eddcc64a54b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1739 microversion: 2.20 time: 0.188180 Nov 08 16:21:44.421138 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 720/1429] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:44 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:44.517165 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a19d3fa7-76d9-4981-9d77-77b79c3175cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:44.519595 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a19d3fa7-76d9-4981-9d77-77b79c3175cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:44.527710 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a19d3fa7-76d9-4981-9d77-77b79c3175cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:44.528445 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a19d3fa7-76d9-4981-9d77-77b79c3175cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:44.529440 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a19d3fa7-76d9-4981-9d77-77b79c3175cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:44.529969 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a19d3fa7-76d9-4981-9d77-77b79c3175cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:44.605940 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a19d3fa7-76d9-4981-9d77-77b79c3175cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 28660 microversion: 2.1 time: 0.092866 Nov 08 16:21:44.610670 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 710/1430] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:44 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 28660 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:45.432761 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-55d4e5b1-08c0-4c55-9a8a-f9fb3ef18144 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:45.432761 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-55d4e5b1-08c0-4c55-9a8a-f9fb3ef18144 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:45.456166 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-55d4e5b1-08c0-4c55-9a8a-f9fb3ef18144 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:45.460633 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-55d4e5b1-08c0-4c55-9a8a-f9fb3ef18144 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:45.461767 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-55d4e5b1-08c0-4c55-9a8a-f9fb3ef18144 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:45.474495 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-55d4e5b1-08c0-4c55-9a8a-f9fb3ef18144 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:45.619071 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-de01be0c-f14e-4b4f-9bf5-031124d4a8b2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:45.620418 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-de01be0c-f14e-4b4f-9bf5-031124d4a8b2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:45.631196 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-de01be0c-f14e-4b4f-9bf5-031124d4a8b2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:45.632529 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-de01be0c-f14e-4b4f-9bf5-031124d4a8b2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:45.633874 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-de01be0c-f14e-4b4f-9bf5-031124d4a8b2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:45.634486 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-de01be0c-f14e-4b4f-9bf5-031124d4a8b2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:45.711017 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-55d4e5b1-08c0-4c55-9a8a-f9fb3ef18144 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:45.719793 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-55d4e5b1-08c0-4c55-9a8a-f9fb3ef18144 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:45.721593 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-55d4e5b1-08c0-4c55-9a8a-f9fb3ef18144 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:45.723600 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-55d4e5b1-08c0-4c55-9a8a-f9fb3ef18144 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1739 microversion: 2.20 time: 0.297135 Nov 08 16:21:45.727559 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-de01be0c-f14e-4b4f-9bf5-031124d4a8b2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 29457 microversion: 2.1 time: 0.113233 Nov 08 16:21:45.731657 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 711/1431] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:45 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 29457 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:21:45.737284 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 721/1432] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:45 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:46.742795 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-930592b3-3b85-46aa-8e91-27bce50db232 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:46.743809 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-930592b3-3b85-46aa-8e91-27bce50db232 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:46.746112 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-74d131c6-6eae-41bb-9cc9-1434de842cca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:46.747174 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-74d131c6-6eae-41bb-9cc9-1434de842cca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:46.755443 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-930592b3-3b85-46aa-8e91-27bce50db232 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:46.755899 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-930592b3-3b85-46aa-8e91-27bce50db232 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:46.759603 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-930592b3-3b85-46aa-8e91-27bce50db232 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:46.760253 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-930592b3-3b85-46aa-8e91-27bce50db232 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:46.765691 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-74d131c6-6eae-41bb-9cc9-1434de842cca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:46.766393 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-74d131c6-6eae-41bb-9cc9-1434de842cca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:46.773103 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-74d131c6-6eae-41bb-9cc9-1434de842cca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:46.774423 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-74d131c6-6eae-41bb-9cc9-1434de842cca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:46.882159 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-930592b3-3b85-46aa-8e91-27bce50db232 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 31300 microversion: 2.1 time: 0.145895 Nov 08 16:21:46.882830 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 712/1433] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:46 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 31300 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:47.095745 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-74d131c6-6eae-41bb-9cc9-1434de842cca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:47.104297 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-74d131c6-6eae-41bb-9cc9-1434de842cca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:47.109962 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-74d131c6-6eae-41bb-9cc9-1434de842cca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:47.112138 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-74d131c6-6eae-41bb-9cc9-1434de842cca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1739 microversion: 2.20 time: 0.369479 Nov 08 16:21:47.113914 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 722/1434] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:46 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1739 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:47.904525 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-24d4571c-69b7-4d26-b69d-0408d1605f5a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:47.906829 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-24d4571c-69b7-4d26-b69d-0408d1605f5a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:47.920514 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-24d4571c-69b7-4d26-b69d-0408d1605f5a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:47.921374 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-24d4571c-69b7-4d26-b69d-0408d1605f5a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:47.923197 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-24d4571c-69b7-4d26-b69d-0408d1605f5a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:47.924143 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-24d4571c-69b7-4d26-b69d-0408d1605f5a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:48.035933 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-24d4571c-69b7-4d26-b69d-0408d1605f5a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 32962 microversion: 2.1 time: 0.144899 Nov 08 16:21:48.036702 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 713/1435] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:47 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 32962 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:48.135036 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c67b4252-cb38-4e9c-9a8a-a87a6582f8bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:48.135651 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c67b4252-cb38-4e9c-9a8a-a87a6582f8bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:48.145856 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c67b4252-cb38-4e9c-9a8a-a87a6582f8bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:48.146305 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c67b4252-cb38-4e9c-9a8a-a87a6582f8bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:48.150637 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c67b4252-cb38-4e9c-9a8a-a87a6582f8bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:48.151359 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c67b4252-cb38-4e9c-9a8a-a87a6582f8bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:48.409308 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c67b4252-cb38-4e9c-9a8a-a87a6582f8bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:48.418016 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c67b4252-cb38-4e9c-9a8a-a87a6582f8bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:48.419746 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c67b4252-cb38-4e9c-9a8a-a87a6582f8bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:48.421110 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c67b4252-cb38-4e9c-9a8a-a87a6582f8bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1739 microversion: 2.20 time: 0.290292 Nov 08 16:21:48.433187 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 723/1436] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:48 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1739 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:49.061334 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-15694314-d9e6-4e06-977f-90127be45a7f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:49.063379 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-15694314-d9e6-4e06-977f-90127be45a7f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:49.085516 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-15694314-d9e6-4e06-977f-90127be45a7f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:49.086579 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-15694314-d9e6-4e06-977f-90127be45a7f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:49.087598 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-15694314-d9e6-4e06-977f-90127be45a7f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:49.088416 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-15694314-d9e6-4e06-977f-90127be45a7f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:49.186439 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-15694314-d9e6-4e06-977f-90127be45a7f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 33815 microversion: 2.1 time: 0.141751 Nov 08 16:21:49.187971 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 714/1437] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:49 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 33815 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:49.441514 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-07da369d-5168-404b-a080-f725817b8b0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:49.442175 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-07da369d-5168-404b-a080-f725817b8b0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:49.452753 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-07da369d-5168-404b-a080-f725817b8b0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:49.462531 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-07da369d-5168-404b-a080-f725817b8b0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:49.463697 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-07da369d-5168-404b-a080-f725817b8b0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:49.464130 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-07da369d-5168-404b-a080-f725817b8b0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:49.713791 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-07da369d-5168-404b-a080-f725817b8b0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:49.726646 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-07da369d-5168-404b-a080-f725817b8b0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:49.728984 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-07da369d-5168-404b-a080-f725817b8b0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:49.730545 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-07da369d-5168-404b-a080-f725817b8b0b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1739 microversion: 2.20 time: 0.293700 Nov 08 16:21:49.731722 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 724/1438] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:49 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1739 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:50.201803 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-8cc6245a-9996-4d72-a1ed-532629b0330d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:50.203664 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-8cc6245a-9996-4d72-a1ed-532629b0330d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:50.213382 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8cc6245a-9996-4d72-a1ed-532629b0330d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:50.214121 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8cc6245a-9996-4d72-a1ed-532629b0330d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:50.215167 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8cc6245a-9996-4d72-a1ed-532629b0330d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:50.215840 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-8cc6245a-9996-4d72-a1ed-532629b0330d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:50.328679 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-8cc6245a-9996-4d72-a1ed-532629b0330d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 34993 microversion: 2.1 time: 0.132832 Nov 08 16:21:50.333748 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 715/1439] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:50 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 34993 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:50.753442 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ca240e0e-c405-48eb-93ac-4a3a5ebed996 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:50.754151 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ca240e0e-c405-48eb-93ac-4a3a5ebed996 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:50.766481 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ca240e0e-c405-48eb-93ac-4a3a5ebed996 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:50.767474 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ca240e0e-c405-48eb-93ac-4a3a5ebed996 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:50.768314 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ca240e0e-c405-48eb-93ac-4a3a5ebed996 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:50.768770 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ca240e0e-c405-48eb-93ac-4a3a5ebed996 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:50.924845 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-ca240e0e-c405-48eb-93ac-4a3a5ebed996 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:50.932865 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-ca240e0e-c405-48eb-93ac-4a3a5ebed996 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:50.934724 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-ca240e0e-c405-48eb-93ac-4a3a5ebed996 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:50.936194 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ca240e0e-c405-48eb-93ac-4a3a5ebed996 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1739 microversion: 2.20 time: 0.190743 Nov 08 16:21:50.936836 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 725/1440] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:50 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:51.342375 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-2315097d-5f12-4ea2-9764-dc81b3232553 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:51.343312 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-2315097d-5f12-4ea2-9764-dc81b3232553 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:51.350437 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2315097d-5f12-4ea2-9764-dc81b3232553 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:51.350882 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2315097d-5f12-4ea2-9764-dc81b3232553 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:51.351846 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2315097d-5f12-4ea2-9764-dc81b3232553 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:51.352280 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-2315097d-5f12-4ea2-9764-dc81b3232553 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:51.536518 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-2315097d-5f12-4ea2-9764-dc81b3232553 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 36251 microversion: 2.1 time: 0.198392 Nov 08 16:21:51.538339 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 716/1441] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:51 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 36251 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:51.955328 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-953aa2ca-b0cb-43c2-9d4e-81fd3b8dafa2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:51.956741 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-953aa2ca-b0cb-43c2-9d4e-81fd3b8dafa2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:51.974230 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-953aa2ca-b0cb-43c2-9d4e-81fd3b8dafa2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:51.974950 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-953aa2ca-b0cb-43c2-9d4e-81fd3b8dafa2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:51.978817 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-953aa2ca-b0cb-43c2-9d4e-81fd3b8dafa2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:51.979506 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-953aa2ca-b0cb-43c2-9d4e-81fd3b8dafa2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:52.204452 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-953aa2ca-b0cb-43c2-9d4e-81fd3b8dafa2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:52.215490 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-953aa2ca-b0cb-43c2-9d4e-81fd3b8dafa2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:52.218475 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-953aa2ca-b0cb-43c2-9d4e-81fd3b8dafa2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:52.219910 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-953aa2ca-b0cb-43c2-9d4e-81fd3b8dafa2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1721 microversion: 2.20 time: 0.268698 Nov 08 16:21:52.233702 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 726/1442] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:51 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:52.549101 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a7caa58c-0bb8-4ff6-9156-770c7c1c04ec tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:52.550131 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a7caa58c-0bb8-4ff6-9156-770c7c1c04ec tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:52.560604 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a7caa58c-0bb8-4ff6-9156-770c7c1c04ec tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:52.561247 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a7caa58c-0bb8-4ff6-9156-770c7c1c04ec tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:52.562237 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a7caa58c-0bb8-4ff6-9156-770c7c1c04ec tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:52.562825 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a7caa58c-0bb8-4ff6-9156-770c7c1c04ec tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:52.649493 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a7caa58c-0bb8-4ff6-9156-770c7c1c04ec tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 37727 microversion: 2.1 time: 0.104382 Nov 08 16:21:52.650887 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 717/1443] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:52 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 37727 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:53.239341 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-6b191066-1890-4159-b58b-614cd8560d75 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:53.239951 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-6b191066-1890-4159-b58b-614cd8560d75 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:53.251747 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6b191066-1890-4159-b58b-614cd8560d75 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:53.253942 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6b191066-1890-4159-b58b-614cd8560d75 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:53.255125 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6b191066-1890-4159-b58b-614cd8560d75 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:53.255241 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6b191066-1890-4159-b58b-614cd8560d75 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:53.521731 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-6b191066-1890-4159-b58b-614cd8560d75 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:53.538106 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-6b191066-1890-4159-b58b-614cd8560d75 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:53.540102 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-6b191066-1890-4159-b58b-614cd8560d75 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:53.541508 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-6b191066-1890-4159-b58b-614cd8560d75 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1721 microversion: 2.20 time: 0.306399 Nov 08 16:21:53.542272 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 727/1444] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:53 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1721 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:53.662799 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-439960fc-a6e9-446a-97a9-74912a8d333a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:53.663973 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-439960fc-a6e9-446a-97a9-74912a8d333a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:53.678480 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-439960fc-a6e9-446a-97a9-74912a8d333a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:53.678929 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-439960fc-a6e9-446a-97a9-74912a8d333a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:53.679730 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-439960fc-a6e9-446a-97a9-74912a8d333a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:53.680164 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-439960fc-a6e9-446a-97a9-74912a8d333a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:53.780173 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-439960fc-a6e9-446a-97a9-74912a8d333a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 38189 microversion: 2.1 time: 0.121339 Nov 08 16:21:53.781402 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 718/1445] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:53 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 38189 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:54.560132 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-74af4c17-9f9a-4a30-8de1-0123b4b90d94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:54.560728 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-74af4c17-9f9a-4a30-8de1-0123b4b90d94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:54.579724 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-74af4c17-9f9a-4a30-8de1-0123b4b90d94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:54.580739 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-74af4c17-9f9a-4a30-8de1-0123b4b90d94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:54.581833 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-74af4c17-9f9a-4a30-8de1-0123b4b90d94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:54.582093 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-74af4c17-9f9a-4a30-8de1-0123b4b90d94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:54.798116 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ee50135a-eb58-42dd-acba-f19c237591e5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:54.800830 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ee50135a-eb58-42dd-acba-f19c237591e5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:54.823940 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ee50135a-eb58-42dd-acba-f19c237591e5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:54.827631 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ee50135a-eb58-42dd-acba-f19c237591e5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:54.828846 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ee50135a-eb58-42dd-acba-f19c237591e5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:54.830503 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ee50135a-eb58-42dd-acba-f19c237591e5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:54.842280 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-74af4c17-9f9a-4a30-8de1-0123b4b90d94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:54.855380 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-74af4c17-9f9a-4a30-8de1-0123b4b90d94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:54.857048 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-74af4c17-9f9a-4a30-8de1-0123b4b90d94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:54.858392 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-74af4c17-9f9a-4a30-8de1-0123b4b90d94 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1724 microversion: 2.20 time: 0.301970 Nov 08 16:21:54.859044 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 728/1446] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:54 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1724 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:54.881775 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-023493c1-1f82-4b6f-a65f-890e47881392 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4282cb78-5772-487e-85d3-8e634f23ff64"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:54.885174 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-023493c1-1f82-4b6f-a65f-890e47881392 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:54.891821 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-023493c1-1f82-4b6f-a65f-890e47881392 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:54.892582 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-023493c1-1f82-4b6f-a65f-890e47881392 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:54.893770 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-023493c1-1f82-4b6f-a65f-890e47881392 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:54.894428 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-023493c1-1f82-4b6f-a65f-890e47881392 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:54.913043 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ee50135a-eb58-42dd-acba-f19c237591e5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 38189 microversion: 2.1 time: 0.123962 Nov 08 16:21:54.917503 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 719/1447] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:54 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 38189 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:55.263701 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-023493c1-1f82-4b6f-a65f-890e47881392 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.388920 Nov 08 16:21:55.264487 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 729/1448] 10.222.0.37 () {62 vars in 1363 bytes} [Mon Nov 8 16:21:54 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/os-volume_attachments => generated 188 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:55.407157 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-04c05165-8aae-4192-9c13-9b0fd5341a09 req-5d962b65-baac-4043-8752-b6db79075e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "name": "network-vif-unplugged", "status": "completed", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:55.410250 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:21:55.410250 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:21:55.433214 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-04c05165-8aae-4192-9c13-9b0fd5341a09 req-5d962b65-baac-4043-8752-b6db79075e01 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:55.433938 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-04c05165-8aae-4192-9c13-9b0fd5341a09 req-5d962b65-baac-4043-8752-b6db79075e01 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:55.443049 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-8c58ebac-6634-4aa6-86b8-df20a3b80fef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:55.443544 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-8c58ebac-6634-4aa6-86b8-df20a3b80fef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:55.453961 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8c58ebac-6634-4aa6-86b8-df20a3b80fef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:55.454490 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8c58ebac-6634-4aa6-86b8-df20a3b80fef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:55.455273 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8c58ebac-6634-4aa6-86b8-df20a3b80fef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:55.457940 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8c58ebac-6634-4aa6-86b8-df20a3b80fef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:55.461786 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.compute.server_external_events [req-04c05165-8aae-4192-9c13-9b0fd5341a09 req-5d962b65-baac-4043-8752-b6db79075e01 service nova] Unable to find a host for instance f0c4ded0-3419-458b-ab12-da310a2b2fd7. Dropping event network-vif-unplugged {{(pid=115523) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 08 16:21:55.465568 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-04c05165-8aae-4192-9c13-9b0fd5341a09 req-5d962b65-baac-4043-8752-b6db79075e01 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.064314 Nov 08 16:21:55.476369 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 720/1449] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:21:55 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 08 16:21:55.791287 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-8c58ebac-6634-4aa6-86b8-df20a3b80fef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "DELETE /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/os-volume_attachments/4282cb78-5772-487e-85d3-8e634f23ff64" status: 202 len: 0 microversion: 2.20 time: 0.351935 Nov 08 16:21:55.792549 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 730/1450] 10.222.0.37 () {60 vars in 1456 bytes} [Mon Nov 8 16:21:55 2021] DELETE /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/os-volume_attachments/4282cb78-5772-487e-85d3-8e634f23ff64 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:21:55.860584 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-710f343f-6033-4078-b5a4-0ba0d6a52fee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:55.861886 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-710f343f-6033-4078-b5a4-0ba0d6a52fee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:55.868896 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-710f343f-6033-4078-b5a4-0ba0d6a52fee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:55.869350 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-710f343f-6033-4078-b5a4-0ba0d6a52fee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:55.870181 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-710f343f-6033-4078-b5a4-0ba0d6a52fee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:55.870831 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-710f343f-6033-4078-b5a4-0ba0d6a52fee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:55.971758 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-710f343f-6033-4078-b5a4-0ba0d6a52fee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action" status: 202 len: 0 microversion: 2.20 time: 0.114890 Nov 08 16:21:55.972682 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 731/1451] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Nov 8 16:21:55 2021] POST /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 08 16:21:55.977287 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e8375f4b-4dc9-4616-be19-96d893cb71e6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:55.978293 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e8375f4b-4dc9-4616-be19-96d893cb71e6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:55.984296 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e8375f4b-4dc9-4616-be19-96d893cb71e6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:55.984749 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e8375f4b-4dc9-4616-be19-96d893cb71e6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:55.985727 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e8375f4b-4dc9-4616-be19-96d893cb71e6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:55.986869 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e8375f4b-4dc9-4616-be19-96d893cb71e6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:56.042790 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-213c63a9-d896-4a79-8c71-3b798440d63f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Action: 'create', calling method: .version_select at 0x7f8c1076f310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1532271561"}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:56.054940 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e8375f4b-4dc9-4616-be19-96d893cb71e6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 38189 microversion: 2.1 time: 0.080903 Nov 08 16:21:56.055629 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 732/1452] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:55 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 38189 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:56.063367 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-61b1c9a9-50c4-41bd-a287-05783107332e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:56.065080 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-61b1c9a9-50c4-41bd-a287-05783107332e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:56.071941 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-61b1c9a9-50c4-41bd-a287-05783107332e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:56.072704 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-61b1c9a9-50c4-41bd-a287-05783107332e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:56.073734 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-61b1c9a9-50c4-41bd-a287-05783107332e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:56.074432 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-213c63a9-d896-4a79-8c71-3b798440d63f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Getting quotas for project 71b067e1fbac491a8e16a4ba91049db9. Resources: {'key_pairs'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:21:56.075063 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-61b1c9a9-50c4-41bd-a287-05783107332e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:56.080955 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-213c63a9-d896-4a79-8c71-3b798440d63f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Getting quotas for user fee92aabd2b546938fb603a624a63098 and project 71b067e1fbac491a8e16a4ba91049db9. Resources: {'key_pairs'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:21:56.214869 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-213c63a9-d896-4a79-8c71-3b798440d63f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Getting quotas for project 71b067e1fbac491a8e16a4ba91049db9. Resources: {'key_pairs'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:21:56.219334 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.quota [None req-213c63a9-d896-4a79-8c71-3b798440d63f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Getting quotas for user fee92aabd2b546938fb603a624a63098 and project 71b067e1fbac491a8e16a4ba91049db9. Resources: {'key_pairs'} {{(pid=115523) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:21:56.235919 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-213c63a9-d896-4a79-8c71-3b798440d63f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.385486 Nov 08 16:21:56.242523 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 721/1453] 10.222.0.37 () {60 vars in 1157 bytes} [Mon Nov 8 16:21:55 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:21:56.602860 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-61b1c9a9-50c4-41bd-a287-05783107332e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:56.613573 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-61b1c9a9-50c4-41bd-a287-05783107332e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:56.615272 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-61b1c9a9-50c4-41bd-a287-05783107332e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:56.617444 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-61b1c9a9-50c4-41bd-a287-05783107332e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1672 microversion: 2.20 time: 0.559232 Nov 08 16:21:56.621767 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 733/1454] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:56 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1672 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:57.067407 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b2d4a337-d017-4df0-93a1-a3ed12ce7fa3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:57.069942 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b2d4a337-d017-4df0-93a1-a3ed12ce7fa3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:57.083041 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b2d4a337-d017-4df0-93a1-a3ed12ce7fa3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:57.083041 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b2d4a337-d017-4df0-93a1-a3ed12ce7fa3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:57.083706 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b2d4a337-d017-4df0-93a1-a3ed12ce7fa3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:57.084454 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b2d4a337-d017-4df0-93a1-a3ed12ce7fa3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:57.175762 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b2d4a337-d017-4df0-93a1-a3ed12ce7fa3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 38255 microversion: 2.1 time: 0.112165 Nov 08 16:21:57.176688 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 722/1455] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:57 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 38255 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 16:21:57.637331 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a9ac50e0-a195-43af-bd05-0d41fe1eac33 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:57.637977 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a9ac50e0-a195-43af-bd05-0d41fe1eac33 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:57.645186 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a9ac50e0-a195-43af-bd05-0d41fe1eac33 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:57.645628 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a9ac50e0-a195-43af-bd05-0d41fe1eac33 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:57.651808 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a9ac50e0-a195-43af-bd05-0d41fe1eac33 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:57.652363 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a9ac50e0-a195-43af-bd05-0d41fe1eac33 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:57.927549 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a9ac50e0-a195-43af-bd05-0d41fe1eac33 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:57.941121 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a9ac50e0-a195-43af-bd05-0d41fe1eac33 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:57.942846 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a9ac50e0-a195-43af-bd05-0d41fe1eac33 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:57.944028 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a9ac50e0-a195-43af-bd05-0d41fe1eac33 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.311822 Nov 08 16:21:57.947061 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 734/1456] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:57 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:58.188382 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9be43ce4-55f6-4fad-abec-56f9f179b64b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:58.190018 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-9be43ce4-55f6-4fad-abec-56f9f179b64b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:58.197071 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9be43ce4-55f6-4fad-abec-56f9f179b64b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:58.197654 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9be43ce4-55f6-4fad-abec-56f9f179b64b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:58.198477 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9be43ce4-55f6-4fad-abec-56f9f179b64b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:58.198913 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-9be43ce4-55f6-4fad-abec-56f9f179b64b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:58.306658 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-9be43ce4-55f6-4fad-abec-56f9f179b64b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action" status: 200 len: 38318 microversion: 2.1 time: 0.122105 Nov 08 16:21:58.307544 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 723/1457] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:21:58 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/action => generated 38318 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 16:21:58.317766 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d1393cd0-28af-40f0-b0b7-d6dad8fb222d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:58.318279 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d1393cd0-28af-40f0-b0b7-d6dad8fb222d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:58.324696 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d1393cd0-28af-40f0-b0b7-d6dad8fb222d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:58.325150 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d1393cd0-28af-40f0-b0b7-d6dad8fb222d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:58.325956 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d1393cd0-28af-40f0-b0b7-d6dad8fb222d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:58.326391 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d1393cd0-28af-40f0-b0b7-d6dad8fb222d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:58.353634 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d1393cd0-28af-40f0-b0b7-d6dad8fb222d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/ips" status: 200 len: 145 microversion: 2.1 time: 0.040253 Nov 08 16:21:58.354349 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 735/1458] 10.222.0.37 () {58 vars in 1247 bytes} [Mon Nov 8 16:21:58 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:21:58.963090 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a35dce3f-093f-4944-9713-d5061a602ce9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:21:58.964010 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a35dce3f-093f-4944-9713-d5061a602ce9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:58.971779 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a35dce3f-093f-4944-9713-d5061a602ce9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:58.972440 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a35dce3f-093f-4944-9713-d5061a602ce9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:58.973382 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a35dce3f-093f-4944-9713-d5061a602ce9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:58.974127 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a35dce3f-093f-4944-9713-d5061a602ce9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:59.192288 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a35dce3f-093f-4944-9713-d5061a602ce9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:59.200588 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a35dce3f-093f-4944-9713-d5061a602ce9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:59.205967 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a35dce3f-093f-4944-9713-d5061a602ce9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:21:59.207552 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a35dce3f-093f-4944-9713-d5061a602ce9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.248355 Nov 08 16:21:59.208141 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 724/1459] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:21:58 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:21:59.734942 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-66dabc70-20db-4bb7-94f7-9f2d67f324f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf76bf8e-0279-495c-a177-d37a9916da92"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:21:59.736595 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-66dabc70-20db-4bb7-94f7-9f2d67f324f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:21:59.743393 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-66dabc70-20db-4bb7-94f7-9f2d67f324f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:59.743777 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-66dabc70-20db-4bb7-94f7-9f2d67f324f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:21:59.744559 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-66dabc70-20db-4bb7-94f7-9f2d67f324f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:21:59.744993 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-66dabc70-20db-4bb7-94f7-9f2d67f324f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:00.226816 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a25c33b5-72b6-4c31-976f-ba73b20ef3fe tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:00.227400 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a25c33b5-72b6-4c31-976f-ba73b20ef3fe tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:00.250484 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a25c33b5-72b6-4c31-976f-ba73b20ef3fe tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:00.250807 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a25c33b5-72b6-4c31-976f-ba73b20ef3fe tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:00.252544 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a25c33b5-72b6-4c31-976f-ba73b20ef3fe tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:00.260940 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a25c33b5-72b6-4c31-976f-ba73b20ef3fe tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:00.453429 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a25c33b5-72b6-4c31-976f-ba73b20ef3fe tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:00.464141 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a25c33b5-72b6-4c31-976f-ba73b20ef3fe tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:00.466561 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a25c33b5-72b6-4c31-976f-ba73b20ef3fe tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:00.468276 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a25c33b5-72b6-4c31-976f-ba73b20ef3fe tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.245151 Nov 08 16:22:00.469209 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 725/1460] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:00 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:22:01.487627 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-7b1fbe69-1271-4895-b007-37a55c8295d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:01.488226 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-7b1fbe69-1271-4895-b007-37a55c8295d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:01.494828 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7b1fbe69-1271-4895-b007-37a55c8295d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:01.495555 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7b1fbe69-1271-4895-b007-37a55c8295d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:01.496319 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7b1fbe69-1271-4895-b007-37a55c8295d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:01.496739 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7b1fbe69-1271-4895-b007-37a55c8295d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:01.636632 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7b1fbe69-1271-4895-b007-37a55c8295d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:01.657688 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7b1fbe69-1271-4895-b007-37a55c8295d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:01.660104 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-7b1fbe69-1271-4895-b007-37a55c8295d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:01.661463 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-7b1fbe69-1271-4895-b007-37a55c8295d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.177579 Nov 08 16:22:01.662079 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 726/1461] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:01 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:22:02.680903 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c628df3d-d643-44c2-990c-f9eb0119ac91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:02.681549 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c628df3d-d643-44c2-990c-f9eb0119ac91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:02.688328 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c628df3d-d643-44c2-990c-f9eb0119ac91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:02.689169 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c628df3d-d643-44c2-990c-f9eb0119ac91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:02.690214 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c628df3d-d643-44c2-990c-f9eb0119ac91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:02.690861 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c628df3d-d643-44c2-990c-f9eb0119ac91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:02.830451 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c628df3d-d643-44c2-990c-f9eb0119ac91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:02.839198 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c628df3d-d643-44c2-990c-f9eb0119ac91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:02.840822 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c628df3d-d643-44c2-990c-f9eb0119ac91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:02.842077 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c628df3d-d643-44c2-990c-f9eb0119ac91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.165351 Nov 08 16:22:02.842746 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 727/1462] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:02 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:22:03.860641 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f8ea7e3b-a8c8-4b1a-bd0e-d9a07f9c2b54 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:03.861854 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f8ea7e3b-a8c8-4b1a-bd0e-d9a07f9c2b54 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:03.869085 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f8ea7e3b-a8c8-4b1a-bd0e-d9a07f9c2b54 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:03.869533 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f8ea7e3b-a8c8-4b1a-bd0e-d9a07f9c2b54 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:03.870506 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f8ea7e3b-a8c8-4b1a-bd0e-d9a07f9c2b54 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:03.870939 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f8ea7e3b-a8c8-4b1a-bd0e-d9a07f9c2b54 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:04.019031 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f8ea7e3b-a8c8-4b1a-bd0e-d9a07f9c2b54 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:04.031144 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f8ea7e3b-a8c8-4b1a-bd0e-d9a07f9c2b54 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:04.032651 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f8ea7e3b-a8c8-4b1a-bd0e-d9a07f9c2b54 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:04.033977 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f8ea7e3b-a8c8-4b1a-bd0e-d9a07f9c2b54 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.176955 Nov 08 16:22:04.034539 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 728/1463] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:03 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:22:05.057921 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4d1773e4-406b-4bd2-b025-2c3e83a244ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:05.066285 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4d1773e4-406b-4bd2-b025-2c3e83a244ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:05.072805 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4d1773e4-406b-4bd2-b025-2c3e83a244ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:05.073279 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4d1773e4-406b-4bd2-b025-2c3e83a244ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:05.074140 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4d1773e4-406b-4bd2-b025-2c3e83a244ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:05.074578 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4d1773e4-406b-4bd2-b025-2c3e83a244ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:05.213531 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4d1773e4-406b-4bd2-b025-2c3e83a244ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:05.222284 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4d1773e4-406b-4bd2-b025-2c3e83a244ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:05.223788 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4d1773e4-406b-4bd2-b025-2c3e83a244ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:05.225132 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4d1773e4-406b-4bd2-b025-2c3e83a244ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.176503 Nov 08 16:22:05.237429 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 729/1464] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:05 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:22:06.243318 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-39b51aa2-5e66-46bf-9ab3-0e678f603dff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:06.243971 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-39b51aa2-5e66-46bf-9ab3-0e678f603dff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:06.250155 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-39b51aa2-5e66-46bf-9ab3-0e678f603dff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:06.250602 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-39b51aa2-5e66-46bf-9ab3-0e678f603dff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:06.251371 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-39b51aa2-5e66-46bf-9ab3-0e678f603dff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:06.252292 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-39b51aa2-5e66-46bf-9ab3-0e678f603dff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:06.405158 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-39b51aa2-5e66-46bf-9ab3-0e678f603dff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:06.416536 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-39b51aa2-5e66-46bf-9ab3-0e678f603dff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:06.418298 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-39b51aa2-5e66-46bf-9ab3-0e678f603dff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:06.419479 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-39b51aa2-5e66-46bf-9ab3-0e678f603dff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.180171 Nov 08 16:22:06.420033 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 730/1465] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:06 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:22:07.437761 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-90ad01d9-028c-4184-8953-049bb9dc1703 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:07.438409 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-90ad01d9-028c-4184-8953-049bb9dc1703 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:07.445274 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-90ad01d9-028c-4184-8953-049bb9dc1703 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:07.445747 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-90ad01d9-028c-4184-8953-049bb9dc1703 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:07.446508 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-90ad01d9-028c-4184-8953-049bb9dc1703 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:07.446928 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-90ad01d9-028c-4184-8953-049bb9dc1703 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:07.583885 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-90ad01d9-028c-4184-8953-049bb9dc1703 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:07.591419 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-90ad01d9-028c-4184-8953-049bb9dc1703 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:07.592895 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-90ad01d9-028c-4184-8953-049bb9dc1703 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:07.594099 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-90ad01d9-028c-4184-8953-049bb9dc1703 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.159936 Nov 08 16:22:07.594645 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 731/1466] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:07 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:22:08.613644 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c273a15b-6cac-4337-aec6-5951363db9fc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:08.614347 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c273a15b-6cac-4337-aec6-5951363db9fc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:08.620965 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c273a15b-6cac-4337-aec6-5951363db9fc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:08.621412 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c273a15b-6cac-4337-aec6-5951363db9fc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:08.622211 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c273a15b-6cac-4337-aec6-5951363db9fc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:08.622643 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c273a15b-6cac-4337-aec6-5951363db9fc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:08.753261 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c273a15b-6cac-4337-aec6-5951363db9fc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:08.760867 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c273a15b-6cac-4337-aec6-5951363db9fc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:08.762434 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c273a15b-6cac-4337-aec6-5951363db9fc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:08.763672 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c273a15b-6cac-4337-aec6-5951363db9fc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.154427 Nov 08 16:22:08.764288 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 732/1467] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:08 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:22:09.782425 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-99906968-4b4d-4b6e-9a6a-c610289e957d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:09.783960 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-99906968-4b4d-4b6e-9a6a-c610289e957d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:09.791670 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-99906968-4b4d-4b6e-9a6a-c610289e957d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:09.792207 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-99906968-4b4d-4b6e-9a6a-c610289e957d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:09.793236 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-99906968-4b4d-4b6e-9a6a-c610289e957d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:09.793827 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-99906968-4b4d-4b6e-9a6a-c610289e957d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:09.932090 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-99906968-4b4d-4b6e-9a6a-c610289e957d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:09.940123 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-99906968-4b4d-4b6e-9a6a-c610289e957d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:09.941619 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-99906968-4b4d-4b6e-9a6a-c610289e957d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:09.942830 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-99906968-4b4d-4b6e-9a6a-c610289e957d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.164896 Nov 08 16:22:09.943390 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 733/1468] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:09 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:22:10.960688 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ef7ab381-558e-4e53-a812-2e2658878372 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:10.961356 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ef7ab381-558e-4e53-a812-2e2658878372 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:10.967421 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ef7ab381-558e-4e53-a812-2e2658878372 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:10.967857 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ef7ab381-558e-4e53-a812-2e2658878372 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:10.968614 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ef7ab381-558e-4e53-a812-2e2658878372 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:10.969037 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ef7ab381-558e-4e53-a812-2e2658878372 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:11.102323 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ef7ab381-558e-4e53-a812-2e2658878372 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:11.112004 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ef7ab381-558e-4e53-a812-2e2658878372 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:11.115057 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ef7ab381-558e-4e53-a812-2e2658878372 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:11.118257 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ef7ab381-558e-4e53-a812-2e2658878372 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.161129 Nov 08 16:22:11.119540 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 734/1469] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:10 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:22:12.137407 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f80fd32a-915e-4a28-9490-5525dc9a40ec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:12.138136 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f80fd32a-915e-4a28-9490-5525dc9a40ec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:12.144233 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f80fd32a-915e-4a28-9490-5525dc9a40ec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:12.144671 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f80fd32a-915e-4a28-9490-5525dc9a40ec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:12.145441 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f80fd32a-915e-4a28-9490-5525dc9a40ec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:12.145906 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f80fd32a-915e-4a28-9490-5525dc9a40ec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:12.272514 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f80fd32a-915e-4a28-9490-5525dc9a40ec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:12.280044 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f80fd32a-915e-4a28-9490-5525dc9a40ec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:12.281533 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f80fd32a-915e-4a28-9490-5525dc9a40ec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:12.282744 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f80fd32a-915e-4a28-9490-5525dc9a40ec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.149424 Nov 08 16:22:12.283793 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 735/1470] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:12 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:22:13.300670 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1af8c28c-ceb5-4220-abae-17c1de6f41f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:13.301299 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1af8c28c-ceb5-4220-abae-17c1de6f41f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:13.307583 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1af8c28c-ceb5-4220-abae-17c1de6f41f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:13.308027 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1af8c28c-ceb5-4220-abae-17c1de6f41f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:13.308791 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1af8c28c-ceb5-4220-abae-17c1de6f41f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:13.309221 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1af8c28c-ceb5-4220-abae-17c1de6f41f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:13.436282 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1af8c28c-ceb5-4220-abae-17c1de6f41f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:13.444377 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1af8c28c-ceb5-4220-abae-17c1de6f41f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:13.445910 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1af8c28c-ceb5-4220-abae-17c1de6f41f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:13.447064 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1af8c28c-ceb5-4220-abae-17c1de6f41f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.150640 Nov 08 16:22:13.447631 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 736/1471] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:13 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:22:14.465621 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b24abdf7-c66b-4f16-85c0-7c121dce4a16 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:14.466316 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b24abdf7-c66b-4f16-85c0-7c121dce4a16 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:14.472494 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b24abdf7-c66b-4f16-85c0-7c121dce4a16 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:14.472969 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b24abdf7-c66b-4f16-85c0-7c121dce4a16 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:14.473757 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b24abdf7-c66b-4f16-85c0-7c121dce4a16 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:14.474190 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b24abdf7-c66b-4f16-85c0-7c121dce4a16 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:14.604227 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b24abdf7-c66b-4f16-85c0-7c121dce4a16 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:14.612351 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b24abdf7-c66b-4f16-85c0-7c121dce4a16 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:14.613876 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b24abdf7-c66b-4f16-85c0-7c121dce4a16 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:14.615033 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b24abdf7-c66b-4f16-85c0-7c121dce4a16 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.153200 Nov 08 16:22:14.615590 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 737/1472] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:14 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:22:15.633310 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c2127c1f-7f3f-43e4-b028-05ce45da1fcd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:15.634015 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c2127c1f-7f3f-43e4-b028-05ce45da1fcd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:15.640073 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c2127c1f-7f3f-43e4-b028-05ce45da1fcd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:15.640503 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c2127c1f-7f3f-43e4-b028-05ce45da1fcd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:15.641257 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c2127c1f-7f3f-43e4-b028-05ce45da1fcd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:15.641679 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c2127c1f-7f3f-43e4-b028-05ce45da1fcd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:15.767997 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c2127c1f-7f3f-43e4-b028-05ce45da1fcd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:15.775945 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c2127c1f-7f3f-43e4-b028-05ce45da1fcd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:15.777459 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c2127c1f-7f3f-43e4-b028-05ce45da1fcd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:15.778680 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c2127c1f-7f3f-43e4-b028-05ce45da1fcd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.149122 Nov 08 16:22:15.779273 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 738/1473] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:15 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:22:16.796609 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4fe6b782-81a2-4aee-96f0-868434565b64 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:16.797270 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4fe6b782-81a2-4aee-96f0-868434565b64 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:16.803508 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4fe6b782-81a2-4aee-96f0-868434565b64 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:16.803956 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4fe6b782-81a2-4aee-96f0-868434565b64 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:16.804728 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4fe6b782-81a2-4aee-96f0-868434565b64 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:16.805158 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4fe6b782-81a2-4aee-96f0-868434565b64 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:16.936471 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4fe6b782-81a2-4aee-96f0-868434565b64 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:16.944151 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4fe6b782-81a2-4aee-96f0-868434565b64 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:16.945651 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4fe6b782-81a2-4aee-96f0-868434565b64 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:16.946829 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4fe6b782-81a2-4aee-96f0-868434565b64 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.153989 Nov 08 16:22:16.947390 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 739/1474] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:16 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:22:17.964409 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b30dac6a-0302-4460-9535-4bdf6cb8cb62 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:17.965010 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-b30dac6a-0302-4460-9535-4bdf6cb8cb62 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:17.971290 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b30dac6a-0302-4460-9535-4bdf6cb8cb62 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:17.971735 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b30dac6a-0302-4460-9535-4bdf6cb8cb62 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:17.972506 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b30dac6a-0302-4460-9535-4bdf6cb8cb62 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:17.972941 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-b30dac6a-0302-4460-9535-4bdf6cb8cb62 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:18.103104 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b30dac6a-0302-4460-9535-4bdf6cb8cb62 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:18.111032 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b30dac6a-0302-4460-9535-4bdf6cb8cb62 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:18.112533 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-b30dac6a-0302-4460-9535-4bdf6cb8cb62 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:18.113694 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b30dac6a-0302-4460-9535-4bdf6cb8cb62 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.153045 Nov 08 16:22:18.114290 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 740/1475] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:17 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:22:19.132370 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-32600903-e1ab-4fa9-a297-3e30a10ecc98 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:19.132967 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-32600903-e1ab-4fa9-a297-3e30a10ecc98 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:19.139262 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-32600903-e1ab-4fa9-a297-3e30a10ecc98 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:19.139705 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-32600903-e1ab-4fa9-a297-3e30a10ecc98 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:19.140476 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-32600903-e1ab-4fa9-a297-3e30a10ecc98 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:19.140908 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-32600903-e1ab-4fa9-a297-3e30a10ecc98 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:19.267305 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-32600903-e1ab-4fa9-a297-3e30a10ecc98 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:19.275023 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-32600903-e1ab-4fa9-a297-3e30a10ecc98 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:19.276551 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-32600903-e1ab-4fa9-a297-3e30a10ecc98 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:19.277702 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-32600903-e1ab-4fa9-a297-3e30a10ecc98 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.149056 Nov 08 16:22:19.278282 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 741/1476] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:19 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:22:20.295519 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1489a5ba-0dfd-4745-899e-a27661d5218d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:20.296183 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1489a5ba-0dfd-4745-899e-a27661d5218d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:20.302366 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1489a5ba-0dfd-4745-899e-a27661d5218d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:20.302807 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1489a5ba-0dfd-4745-899e-a27661d5218d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:20.303578 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1489a5ba-0dfd-4745-899e-a27661d5218d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:20.304004 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1489a5ba-0dfd-4745-899e-a27661d5218d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:20.437604 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1489a5ba-0dfd-4745-899e-a27661d5218d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:20.446025 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1489a5ba-0dfd-4745-899e-a27661d5218d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:20.447523 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-1489a5ba-0dfd-4745-899e-a27661d5218d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:20.448701 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1489a5ba-0dfd-4745-899e-a27661d5218d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.156956 Nov 08 16:22:20.449244 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 742/1477] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:20 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 16:22:20.534935 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-66dabc70-20db-4bb7-94f7-9f2d67f324f6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 20.803390 Nov 08 16:22:20.535538 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 736/1478] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Nov 8 16:21:59 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments => generated 194 bytes in 20805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:22:21.467233 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-bdacb398-b7b1-4226-a9c0-fc54601f135e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:21.467832 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-bdacb398-b7b1-4226-a9c0-fc54601f135e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:21.474764 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bdacb398-b7b1-4226-a9c0-fc54601f135e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:21.475125 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bdacb398-b7b1-4226-a9c0-fc54601f135e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:21.475882 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bdacb398-b7b1-4226-a9c0-fc54601f135e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:21.476314 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bdacb398-b7b1-4226-a9c0-fc54601f135e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:21.664145 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-bdacb398-b7b1-4226-a9c0-fc54601f135e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:21.672223 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-bdacb398-b7b1-4226-a9c0-fc54601f135e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:21.674388 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-bdacb398-b7b1-4226-a9c0-fc54601f135e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:21.675541 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-bdacb398-b7b1-4226-a9c0-fc54601f135e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.212084 Nov 08 16:22:21.676099 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 743/1479] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:21 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:22:22.694304 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-503ad185-2238-4c14-b1ac-d2eb6a019e47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:22.694987 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-503ad185-2238-4c14-b1ac-d2eb6a019e47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:22.702146 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-503ad185-2238-4c14-b1ac-d2eb6a019e47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:22.702589 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-503ad185-2238-4c14-b1ac-d2eb6a019e47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:22.703348 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-503ad185-2238-4c14-b1ac-d2eb6a019e47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:22.703777 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-503ad185-2238-4c14-b1ac-d2eb6a019e47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:22.834731 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-503ad185-2238-4c14-b1ac-d2eb6a019e47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:22.842315 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-503ad185-2238-4c14-b1ac-d2eb6a019e47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:22.843822 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-503ad185-2238-4c14-b1ac-d2eb6a019e47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:22.844967 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-503ad185-2238-4c14-b1ac-d2eb6a019e47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.154748 Nov 08 16:22:22.845568 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 737/1480] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:22 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:22:23.863389 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-045d9dfa-8c96-440f-9881-ee6d796d6166 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:23.864012 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-045d9dfa-8c96-440f-9881-ee6d796d6166 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:23.870485 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-045d9dfa-8c96-440f-9881-ee6d796d6166 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:23.870923 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-045d9dfa-8c96-440f-9881-ee6d796d6166 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:23.871679 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-045d9dfa-8c96-440f-9881-ee6d796d6166 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:23.872097 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-045d9dfa-8c96-440f-9881-ee6d796d6166 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:23.999552 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-045d9dfa-8c96-440f-9881-ee6d796d6166 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:24.007738 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-045d9dfa-8c96-440f-9881-ee6d796d6166 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:24.009231 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-045d9dfa-8c96-440f-9881-ee6d796d6166 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:24.010422 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-045d9dfa-8c96-440f-9881-ee6d796d6166 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.151272 Nov 08 16:22:24.010983 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 744/1481] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:23 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:22:24.218454 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ce46d424-96fb-485a-ba78-6a8eab98b795 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1933647184", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1532271561", "security_groups": [{"name": "tempest-secgroup-smoke-1970754233"}], "networks": [{"uuid": "f9b0f22e-a782-44ad-bfe0-8de1f795305e"}], "block_device_mapping_v2": [{"uuid": "da8ac352-e726-4747-ac7e-fcdaf91d3aac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:22:24.323032 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.network.neutron [None req-ce46d424-96fb-485a-ba78-6a8eab98b795 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] validate_networks() for [('f9b0f22e-a782-44ad-bfe0-8de1f795305e', None, None, None, None, None)] {{(pid=115524) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:22:24.682367 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-ce46d424-96fb-485a-ba78-6a8eab98b795 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Flavor limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:22:24.682797 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-ce46d424-96fb-485a-ba78-6a8eab98b795 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Image limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:22:24.683268 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-ce46d424-96fb-485a-ba78-6a8eab98b795 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Flavor pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:22:24.683677 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-ce46d424-96fb-485a-ba78-6a8eab98b795 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Image pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:22:24.684089 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-ce46d424-96fb-485a-ba78-6a8eab98b795 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:22:24.692511 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ce46d424-96fb-485a-ba78-6a8eab98b795 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:24.692958 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ce46d424-96fb-485a-ba78-6a8eab98b795 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:24.693789 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ce46d424-96fb-485a-ba78-6a8eab98b795 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:24.694223 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ce46d424-96fb-485a-ba78-6a8eab98b795 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:24.709841 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-ce46d424-96fb-485a-ba78-6a8eab98b795 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Getting quotas for project 71b067e1fbac491a8e16a4ba91049db9. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:22:24.713653 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-ce46d424-96fb-485a-ba78-6a8eab98b795 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Getting quotas for user fee92aabd2b546938fb603a624a63098 and project 71b067e1fbac491a8e16a4ba91049db9. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:22:24.767719 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ce46d424-96fb-485a-ba78-6a8eab98b795 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Going to run 1 instances... {{(pid=115524) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:22:24.769894 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ce46d424-96fb-485a-ba78-6a8eab98b795 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da8ac352-e726-4747-ac7e-fcdaf91d3aac',volume_size=None,volume_type=None)] {{(pid=115524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:22:24.889241 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ce46d424-96fb-485a-ba78-6a8eab98b795 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.674421 Nov 08 16:22:24.889902 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 738/1482] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Nov 8 16:22:24 2021] POST /compute/v2.1/servers => generated 406 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 16:22:24.899483 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9aba1bbf-a15f-40d9-b1b4-13582ac73e25 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:24.900082 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-9aba1bbf-a15f-40d9-b1b4-13582ac73e25 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:24.951224 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-9aba1bbf-a15f-40d9-b1b4-13582ac73e25 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:24.957888 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-9aba1bbf-a15f-40d9-b1b4-13582ac73e25 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1089 microversion: 2.1 time: 0.062000 Nov 08 16:22:24.958456 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 745/1483] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:24 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1089 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:22:25.028126 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9526bb51-7aae-4fb6-8660-ef1575a75a29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:25.028814 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-9526bb51-7aae-4fb6-8660-ef1575a75a29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:25.035490 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9526bb51-7aae-4fb6-8660-ef1575a75a29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:25.036004 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9526bb51-7aae-4fb6-8660-ef1575a75a29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:25.036838 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9526bb51-7aae-4fb6-8660-ef1575a75a29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:25.037355 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-9526bb51-7aae-4fb6-8660-ef1575a75a29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:25.197635 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-9526bb51-7aae-4fb6-8660-ef1575a75a29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:25.206440 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-9526bb51-7aae-4fb6-8660-ef1575a75a29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:25.207983 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-9526bb51-7aae-4fb6-8660-ef1575a75a29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:25.209185 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9526bb51-7aae-4fb6-8660-ef1575a75a29 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.184835 Nov 08 16:22:25.209757 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 739/1484] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:25 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:22:25.976205 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c97ca7d6-9dba-452c-81f3-93ff4fadaced tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:25.976848 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-c97ca7d6-9dba-452c-81f3-93ff4fadaced tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:25.986796 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c97ca7d6-9dba-452c-81f3-93ff4fadaced tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:25.987231 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c97ca7d6-9dba-452c-81f3-93ff4fadaced tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:25.988006 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c97ca7d6-9dba-452c-81f3-93ff4fadaced tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:25.988456 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-c97ca7d6-9dba-452c-81f3-93ff4fadaced tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:26.052241 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-c97ca7d6-9dba-452c-81f3-93ff4fadaced tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:26.059412 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c97ca7d6-9dba-452c-81f3-93ff4fadaced tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1205 microversion: 2.1 time: 0.088426 Nov 08 16:22:26.059974 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 746/1485] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:25 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1205 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:22:26.227447 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-608aee7e-502d-48ea-9d87-3477c1deebf6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:26.228006 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-608aee7e-502d-48ea-9d87-3477c1deebf6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:26.234207 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-608aee7e-502d-48ea-9d87-3477c1deebf6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:26.234665 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-608aee7e-502d-48ea-9d87-3477c1deebf6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:26.235470 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-608aee7e-502d-48ea-9d87-3477c1deebf6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:26.236504 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-608aee7e-502d-48ea-9d87-3477c1deebf6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:26.444197 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-608aee7e-502d-48ea-9d87-3477c1deebf6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:26.452036 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-608aee7e-502d-48ea-9d87-3477c1deebf6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:26.453633 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-608aee7e-502d-48ea-9d87-3477c1deebf6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:26.454911 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-608aee7e-502d-48ea-9d87-3477c1deebf6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.231396 Nov 08 16:22:26.455570 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 740/1486] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:26 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:22:27.076723 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-896b364c-e369-4e20-b1e5-45ae8bf62f5f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:27.077497 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-896b364c-e369-4e20-b1e5-45ae8bf62f5f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:27.086675 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-896b364c-e369-4e20-b1e5-45ae8bf62f5f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:27.087269 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-896b364c-e369-4e20-b1e5-45ae8bf62f5f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:27.088056 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-896b364c-e369-4e20-b1e5-45ae8bf62f5f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:27.088478 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-896b364c-e369-4e20-b1e5-45ae8bf62f5f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:27.342315 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-896b364c-e369-4e20-b1e5-45ae8bf62f5f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:27.342623 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-f80dd0c2-3887-43e5-bdd0-b93575569af6 req-92e6fcfe-ac41-48a8-9a05-c641373c856f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "name": "network-vif-plugged", "status": "completed", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:22:27.344299 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:22:27.344299 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:22:27.352888 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-f80dd0c2-3887-43e5-bdd0-b93575569af6 req-92e6fcfe-ac41-48a8-9a05-c641373c856f service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:27.353940 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-f80dd0c2-3887-43e5-bdd0-b93575569af6 req-92e6fcfe-ac41-48a8-9a05-c641373c856f service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:27.355788 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-896b364c-e369-4e20-b1e5-45ae8bf62f5f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1273 microversion: 2.1 time: 0.283170 Nov 08 16:22:27.357073 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 747/1487] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:27 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1273 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:22:27.374947 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-f80dd0c2-3887-43e5-bdd0-b93575569af6 req-92e6fcfe-ac41-48a8-9a05-c641373c856f service nova] Creating event network-vif-plugged:b3094cea-72ef-41cf-ac88-a6d678f0fb09 for instance f0c4ded0-3419-458b-ab12-da310a2b2fd7 on hv-cinder-81618 Nov 08 16:22:27.381069 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-f80dd0c2-3887-43e5-bdd0-b93575569af6 req-92e6fcfe-ac41-48a8-9a05-c641373c856f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139995 Nov 08 16:22:27.382228 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 741/1488] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:22:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:22:27.472624 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-16101c36-6531-4442-bac1-6efe676395c0 req-391cf40f-ac14-4b15-be25-7aecdeb5623f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "tag": "e8c812be-3317-46f0-9044-f415824262be"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:22:27.478225 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:22:27.478225 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:22:27.493281 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-211afd62-22e9-4371-9d1a-20ca7e67e053 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:27.494033 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-211afd62-22e9-4371-9d1a-20ca7e67e053 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:27.509622 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-16101c36-6531-4442-bac1-6efe676395c0 req-391cf40f-ac14-4b15-be25-7aecdeb5623f service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:27.510277 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-16101c36-6531-4442-bac1-6efe676395c0 req-391cf40f-ac14-4b15-be25-7aecdeb5623f service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:27.510966 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-211afd62-22e9-4371-9d1a-20ca7e67e053 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:27.511416 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-211afd62-22e9-4371-9d1a-20ca7e67e053 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:27.512206 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-211afd62-22e9-4371-9d1a-20ca7e67e053 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:27.519288 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-211afd62-22e9-4371-9d1a-20ca7e67e053 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:27.527941 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-16101c36-6531-4442-bac1-6efe676395c0 req-391cf40f-ac14-4b15-be25-7aecdeb5623f service nova] Creating event network-changed:e8c812be-3317-46f0-9044-f415824262be for instance 8472eae0-c7a0-4a09-855d-0d96cce75e92 on hv-cinder-81618 Nov 08 16:22:27.534595 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-16101c36-6531-4442-bac1-6efe676395c0 req-391cf40f-ac14-4b15-be25-7aecdeb5623f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072214 Nov 08 16:22:27.540290 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 748/1489] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:22:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:22:27.784316 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-211afd62-22e9-4371-9d1a-20ca7e67e053 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:27.792231 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-211afd62-22e9-4371-9d1a-20ca7e67e053 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:27.793759 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-211afd62-22e9-4371-9d1a-20ca7e67e053 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:27.794915 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-211afd62-22e9-4371-9d1a-20ca7e67e053 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.322273 Nov 08 16:22:27.795649 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 742/1490] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:27 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:22:28.000887 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-104caa45-ad0f-4988-a29f-5e4598144561 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:28.002535 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-104caa45-ad0f-4988-a29f-5e4598144561 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:28.008493 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-104caa45-ad0f-4988-a29f-5e4598144561 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:28.008935 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-104caa45-ad0f-4988-a29f-5e4598144561 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:28.009755 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-104caa45-ad0f-4988-a29f-5e4598144561 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:28.010168 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-104caa45-ad0f-4988-a29f-5e4598144561 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:28.038501 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-104caa45-ad0f-4988-a29f-5e4598144561 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041701 Nov 08 16:22:28.039047 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 749/1491] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:22:27 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:22:28.049117 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-dac853c6-6a5d-495d-b5a8-05bd51d782c5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:28.049603 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-dac853c6-6a5d-495d-b5a8-05bd51d782c5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:28.055305 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dac853c6-6a5d-495d-b5a8-05bd51d782c5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:28.055746 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dac853c6-6a5d-495d-b5a8-05bd51d782c5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:28.056505 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dac853c6-6a5d-495d-b5a8-05bd51d782c5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:28.056935 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dac853c6-6a5d-495d-b5a8-05bd51d782c5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:28.084901 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-dac853c6-6a5d-495d-b5a8-05bd51d782c5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments/cf76bf8e-0279-495c-a177-d37a9916da92" status: 200 len: 194 microversion: 2.1 time: 0.040025 Nov 08 16:22:28.085501 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 743/1492] 10.222.0.37 () {58 vars in 1412 bytes} [Mon Nov 8 16:22:28 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments/cf76bf8e-0279-495c-a177-d37a9916da92 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:22:28.372849 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-430288a6-49b4-4b8a-92e6-9d2a105f1b6d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:28.373506 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-430288a6-49b4-4b8a-92e6-9d2a105f1b6d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:28.380258 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-430288a6-49b4-4b8a-92e6-9d2a105f1b6d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:28.381027 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-430288a6-49b4-4b8a-92e6-9d2a105f1b6d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:28.381984 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-430288a6-49b4-4b8a-92e6-9d2a105f1b6d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:28.382643 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-430288a6-49b4-4b8a-92e6-9d2a105f1b6d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:28.542211 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-430288a6-49b4-4b8a-92e6-9d2a105f1b6d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:28.549474 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-430288a6-49b4-4b8a-92e6-9d2a105f1b6d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1261 microversion: 2.1 time: 0.180334 Nov 08 16:22:28.550109 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 750/1493] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:28 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:22:28.813226 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-510a865c-a5f7-4c4a-8ac6-a8181d677c4e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:28.814462 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-510a865c-a5f7-4c4a-8ac6-a8181d677c4e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:28.820753 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-510a865c-a5f7-4c4a-8ac6-a8181d677c4e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:28.821204 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-510a865c-a5f7-4c4a-8ac6-a8181d677c4e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:28.822004 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-510a865c-a5f7-4c4a-8ac6-a8181d677c4e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:28.822445 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-510a865c-a5f7-4c4a-8ac6-a8181d677c4e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:29.262498 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-510a865c-a5f7-4c4a-8ac6-a8181d677c4e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:29.270297 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-510a865c-a5f7-4c4a-8ac6-a8181d677c4e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:29.271815 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-510a865c-a5f7-4c4a-8ac6-a8181d677c4e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:29.272981 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-510a865c-a5f7-4c4a-8ac6-a8181d677c4e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1730 microversion: 2.20 time: 0.463706 Nov 08 16:22:29.273544 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 744/1494] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:28 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1730 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:22:29.406000 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4871b620-8014-48de-8997-2bb2ed784ca4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "763da628-2fb2-4f7e-929f-bd613deabe01"}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:22:29.407076 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4871b620-8014-48de-8997-2bb2ed784ca4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:29.413781 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4871b620-8014-48de-8997-2bb2ed784ca4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:29.414230 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4871b620-8014-48de-8997-2bb2ed784ca4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:29.415000 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4871b620-8014-48de-8997-2bb2ed784ca4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:29.415431 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4871b620-8014-48de-8997-2bb2ed784ca4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:29.566226 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e6a289f8-cd7e-4b8d-adaf-fb508bfef923 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:29.566899 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e6a289f8-cd7e-4b8d-adaf-fb508bfef923 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:29.573246 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e6a289f8-cd7e-4b8d-adaf-fb508bfef923 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:29.573697 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e6a289f8-cd7e-4b8d-adaf-fb508bfef923 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:29.574527 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e6a289f8-cd7e-4b8d-adaf-fb508bfef923 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:29.574958 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e6a289f8-cd7e-4b8d-adaf-fb508bfef923 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:29.661145 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4871b620-8014-48de-8997-2bb2ed784ca4 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258429 Nov 08 16:22:29.661761 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 751/1495] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Nov 8 16:22:29 2021] POST /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:22:29.734393 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e6a289f8-cd7e-4b8d-adaf-fb508bfef923 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:29.742971 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e6a289f8-cd7e-4b8d-adaf-fb508bfef923 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1261 microversion: 2.1 time: 0.180504 Nov 08 16:22:29.751981 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 745/1496] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:29 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:22:30.292015 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6bc34206-6ba2-4627-9c56-47df28af9e31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:30.292722 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6bc34206-6ba2-4627-9c56-47df28af9e31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:30.299712 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6bc34206-6ba2-4627-9c56-47df28af9e31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:30.300148 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6bc34206-6ba2-4627-9c56-47df28af9e31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:30.300915 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6bc34206-6ba2-4627-9c56-47df28af9e31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:30.301335 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6bc34206-6ba2-4627-9c56-47df28af9e31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:30.432920 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6bc34206-6ba2-4627-9c56-47df28af9e31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:30.441224 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6bc34206-6ba2-4627-9c56-47df28af9e31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:30.442744 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6bc34206-6ba2-4627-9c56-47df28af9e31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:30.443885 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6bc34206-6ba2-4627-9c56-47df28af9e31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1717 microversion: 2.20 time: 0.155934 Nov 08 16:22:30.444433 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 752/1497] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:22:30 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:22:30.759282 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5880f942-47b7-4bb9-b9a5-abf691bb73f9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:30.759872 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5880f942-47b7-4bb9-b9a5-abf691bb73f9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:30.769826 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5880f942-47b7-4bb9-b9a5-abf691bb73f9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:30.770280 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5880f942-47b7-4bb9-b9a5-abf691bb73f9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:30.771066 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5880f942-47b7-4bb9-b9a5-abf691bb73f9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:30.771500 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5880f942-47b7-4bb9-b9a5-abf691bb73f9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:30.901273 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-5880f942-47b7-4bb9-b9a5-abf691bb73f9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:30.909366 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5880f942-47b7-4bb9-b9a5-abf691bb73f9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1261 microversion: 2.1 time: 0.153712 Nov 08 16:22:30.910044 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 746/1498] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:30 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:22:31.926040 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-87de5b44-b764-4eed-9e69-bd5ce7b9e6b1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:31.926558 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-87de5b44-b764-4eed-9e69-bd5ce7b9e6b1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:31.932785 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-87de5b44-b764-4eed-9e69-bd5ce7b9e6b1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:31.933226 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-87de5b44-b764-4eed-9e69-bd5ce7b9e6b1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:31.934023 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-87de5b44-b764-4eed-9e69-bd5ce7b9e6b1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:31.934453 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-87de5b44-b764-4eed-9e69-bd5ce7b9e6b1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:32.060145 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-87de5b44-b764-4eed-9e69-bd5ce7b9e6b1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:32.067340 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-87de5b44-b764-4eed-9e69-bd5ce7b9e6b1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1261 microversion: 2.1 time: 0.145089 Nov 08 16:22:32.067899 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 753/1499] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:31 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1261 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:22:33.084606 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f255e2d1-dd08-4c83-a72e-04716d594490 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:33.085140 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-f255e2d1-dd08-4c83-a72e-04716d594490 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:33.091444 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f255e2d1-dd08-4c83-a72e-04716d594490 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:33.091891 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f255e2d1-dd08-4c83-a72e-04716d594490 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:33.092665 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f255e2d1-dd08-4c83-a72e-04716d594490 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:33.093101 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-f255e2d1-dd08-4c83-a72e-04716d594490 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:33.220959 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-f255e2d1-dd08-4c83-a72e-04716d594490 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:33.228306 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f255e2d1-dd08-4c83-a72e-04716d594490 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1261 microversion: 2.1 time: 0.147442 Nov 08 16:22:33.228881 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 747/1500] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:33 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:22:34.245046 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f6cd5db7-6498-46a0-a3a2-a415af73b648 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:34.245651 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f6cd5db7-6498-46a0-a3a2-a415af73b648 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:34.251895 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f6cd5db7-6498-46a0-a3a2-a415af73b648 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:34.252338 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f6cd5db7-6498-46a0-a3a2-a415af73b648 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:34.253108 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f6cd5db7-6498-46a0-a3a2-a415af73b648 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:34.253535 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f6cd5db7-6498-46a0-a3a2-a415af73b648 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:34.383405 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-f6cd5db7-6498-46a0-a3a2-a415af73b648 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:34.390594 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f6cd5db7-6498-46a0-a3a2-a415af73b648 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1261 microversion: 2.1 time: 0.149518 Nov 08 16:22:34.391162 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 754/1501] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:34 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:22:35.407930 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c205132e-3eed-4ff5-87fb-66a164670571 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:35.408596 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c205132e-3eed-4ff5-87fb-66a164670571 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:35.414838 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c205132e-3eed-4ff5-87fb-66a164670571 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:35.415286 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c205132e-3eed-4ff5-87fb-66a164670571 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:35.416051 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c205132e-3eed-4ff5-87fb-66a164670571 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:35.416483 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c205132e-3eed-4ff5-87fb-66a164670571 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:35.543156 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-c205132e-3eed-4ff5-87fb-66a164670571 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:35.550826 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c205132e-3eed-4ff5-87fb-66a164670571 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1261 microversion: 2.1 time: 0.147053 Nov 08 16:22:35.551382 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 748/1502] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:35 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:22:36.567911 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6e06ef49-3247-4e44-b7a4-93c25d5ceea9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:36.568513 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6e06ef49-3247-4e44-b7a4-93c25d5ceea9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:36.574733 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6e06ef49-3247-4e44-b7a4-93c25d5ceea9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:36.575165 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6e06ef49-3247-4e44-b7a4-93c25d5ceea9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:36.575922 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6e06ef49-3247-4e44-b7a4-93c25d5ceea9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:36.576342 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6e06ef49-3247-4e44-b7a4-93c25d5ceea9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:36.707398 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6e06ef49-3247-4e44-b7a4-93c25d5ceea9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:36.714490 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6e06ef49-3247-4e44-b7a4-93c25d5ceea9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1261 microversion: 2.1 time: 0.150879 Nov 08 16:22:36.715057 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 755/1503] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:36 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:22:37.114473 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-b225e92b-e3f1-45e0-8c52-36c5c91c084c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:37.115444 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-b225e92b-e3f1-45e0-8c52-36c5c91c084c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:37.121993 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b225e92b-e3f1-45e0-8c52-36c5c91c084c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:37.122424 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b225e92b-e3f1-45e0-8c52-36c5c91c084c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:37.123193 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b225e92b-e3f1-45e0-8c52-36c5c91c084c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:37.123622 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-b225e92b-e3f1-45e0-8c52-36c5c91c084c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:37.153316 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-b225e92b-e3f1-45e0-8c52-36c5c91c084c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043154 Nov 08 16:22:37.154207 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 749/1504] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:22:37 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:22:37.405247 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-1cda80f0-f7cf-4871-8505-82077e913cbd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:37.405695 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-1cda80f0-f7cf-4871-8505-82077e913cbd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:37.411652 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1cda80f0-f7cf-4871-8505-82077e913cbd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:37.412095 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1cda80f0-f7cf-4871-8505-82077e913cbd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:37.412859 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1cda80f0-f7cf-4871-8505-82077e913cbd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:37.413289 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-1cda80f0-f7cf-4871-8505-82077e913cbd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:37.441672 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-1cda80f0-f7cf-4871-8505-82077e913cbd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments/cf76bf8e-0279-495c-a177-d37a9916da92" status: 200 len: 194 microversion: 2.1 time: 0.040333 Nov 08 16:22:37.442264 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 756/1505] 10.222.0.37 () {58 vars in 1412 bytes} [Mon Nov 8 16:22:37 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments/cf76bf8e-0279-495c-a177-d37a9916da92 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:22:37.451389 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-21640445-7ba1-47c6-a860-f6fce017fecb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:37.451885 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-21640445-7ba1-47c6-a860-f6fce017fecb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:37.458233 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-21640445-7ba1-47c6-a860-f6fce017fecb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:37.458683 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-21640445-7ba1-47c6-a860-f6fce017fecb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:37.459456 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-21640445-7ba1-47c6-a860-f6fce017fecb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:37.459891 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-21640445-7ba1-47c6-a860-f6fce017fecb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:37.537207 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.objects.instance [None req-21640445-7ba1-47c6-a860-f6fce017fecb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lazy-loading 'services' on Instance uuid 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b {{(pid=115524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:22:37.604610 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-21640445-7ba1-47c6-a860-f6fce017fecb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "DELETE /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments/cf76bf8e-0279-495c-a177-d37a9916da92" status: 202 len: 0 microversion: 2.1 time: 0.156734 Nov 08 16:22:37.605303 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 750/1506] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Nov 8 16:22:37 2021] DELETE /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments/cf76bf8e-0279-495c-a177-d37a9916da92 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:22:37.730298 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a412f190-d377-426e-a12c-1b002c3c5e17 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:37.730898 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a412f190-d377-426e-a12c-1b002c3c5e17 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:37.737213 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a412f190-d377-426e-a12c-1b002c3c5e17 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:37.737651 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a412f190-d377-426e-a12c-1b002c3c5e17 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:37.738453 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a412f190-d377-426e-a12c-1b002c3c5e17 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:37.738880 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a412f190-d377-426e-a12c-1b002c3c5e17 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:37.871464 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a412f190-d377-426e-a12c-1b002c3c5e17 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:37.879874 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a412f190-d377-426e-a12c-1b002c3c5e17 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1261 microversion: 2.1 time: 0.153079 Nov 08 16:22:37.880751 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 757/1507] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:37 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:22:38.898181 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e8cfc513-fe84-46a0-8245-2d7f5f9458ca tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:38.898881 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e8cfc513-fe84-46a0-8245-2d7f5f9458ca tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:38.904780 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e8cfc513-fe84-46a0-8245-2d7f5f9458ca tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:38.905232 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e8cfc513-fe84-46a0-8245-2d7f5f9458ca tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:38.906030 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e8cfc513-fe84-46a0-8245-2d7f5f9458ca tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:38.906483 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e8cfc513-fe84-46a0-8245-2d7f5f9458ca tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:39.045401 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e8cfc513-fe84-46a0-8245-2d7f5f9458ca tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:39.052897 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e8cfc513-fe84-46a0-8245-2d7f5f9458ca tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1261 microversion: 2.1 time: 0.159504 Nov 08 16:22:39.053463 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 751/1508] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:38 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:22:39.252590 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-90671e69-9d94-4aaf-94e0-80d21d66b4e3 req-cd5d81d6-a0b2-4d83-a015-8b06e701027a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "name": "network-vif-plugged", "status": "completed", "tag": "e8c812be-3317-46f0-9044-f415824262be"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:22:39.254194 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:22:39.254194 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:22:39.261972 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-90671e69-9d94-4aaf-94e0-80d21d66b4e3 req-cd5d81d6-a0b2-4d83-a015-8b06e701027a service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:39.262896 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-90671e69-9d94-4aaf-94e0-80d21d66b4e3 req-cd5d81d6-a0b2-4d83-a015-8b06e701027a service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:39.273948 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-90671e69-9d94-4aaf-94e0-80d21d66b4e3 req-cd5d81d6-a0b2-4d83-a015-8b06e701027a service nova] Creating event network-vif-plugged:e8c812be-3317-46f0-9044-f415824262be for instance 8472eae0-c7a0-4a09-855d-0d96cce75e92 on hv-cinder-81618 Nov 08 16:22:39.278725 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-90671e69-9d94-4aaf-94e0-80d21d66b4e3 req-cd5d81d6-a0b2-4d83-a015-8b06e701027a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030390 Nov 08 16:22:39.279306 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 758/1509] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:22:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:22:39.758617 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-c696aaac-24c8-426c-a7ae-ce803e938453 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:39.759047 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-c696aaac-24c8-426c-a7ae-ce803e938453 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:39.764881 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c696aaac-24c8-426c-a7ae-ce803e938453 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:39.765335 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c696aaac-24c8-426c-a7ae-ce803e938453 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:39.766141 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c696aaac-24c8-426c-a7ae-ce803e938453 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:39.766575 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-c696aaac-24c8-426c-a7ae-ce803e938453 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:39.794948 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-c696aaac-24c8-426c-a7ae-ce803e938453 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments/763da628-2fb2-4f7e-929f-bd613deabe01" status: 200 len: 194 microversion: 2.1 time: 0.040127 Nov 08 16:22:39.795527 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 752/1510] 10.222.0.37 () {58 vars in 1412 bytes} [Mon Nov 8 16:22:39 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments/763da628-2fb2-4f7e-929f-bd613deabe01 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:22:39.805366 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-320ce948-fec2-4e6c-84e2-39df79e08611 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:39.806006 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-320ce948-fec2-4e6c-84e2-39df79e08611 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:39.811911 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-320ce948-fec2-4e6c-84e2-39df79e08611 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:39.812359 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-320ce948-fec2-4e6c-84e2-39df79e08611 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:39.813123 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-320ce948-fec2-4e6c-84e2-39df79e08611 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:39.813550 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-320ce948-fec2-4e6c-84e2-39df79e08611 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:39.892710 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.objects.instance [None req-320ce948-fec2-4e6c-84e2-39df79e08611 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lazy-loading 'services' on Instance uuid 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b {{(pid=115523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:22:39.958875 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-320ce948-fec2-4e6c-84e2-39df79e08611 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "DELETE /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments/763da628-2fb2-4f7e-929f-bd613deabe01" status: 202 len: 0 microversion: 2.1 time: 0.157358 Nov 08 16:22:39.959447 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 759/1511] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Nov 8 16:22:39 2021] DELETE /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments/763da628-2fb2-4f7e-929f-bd613deabe01 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:22:40.070106 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-87c0c096-7fcd-40c0-8f95-56dcce6d9085 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:40.070705 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-87c0c096-7fcd-40c0-8f95-56dcce6d9085 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:40.076798 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-87c0c096-7fcd-40c0-8f95-56dcce6d9085 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:40.077238 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-87c0c096-7fcd-40c0-8f95-56dcce6d9085 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:40.078022 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-87c0c096-7fcd-40c0-8f95-56dcce6d9085 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:40.078455 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-87c0c096-7fcd-40c0-8f95-56dcce6d9085 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:40.207235 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-87c0c096-7fcd-40c0-8f95-56dcce6d9085 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:40.214401 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-87c0c096-7fcd-40c0-8f95-56dcce6d9085 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1261 microversion: 2.1 time: 0.148099 Nov 08 16:22:40.214963 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 753/1512] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:40 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:22:41.108933 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-aba95f63-874b-46ab-9748-301ef17cf7da tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:41.110014 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-aba95f63-874b-46ab-9748-301ef17cf7da tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:41.116725 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-aba95f63-874b-46ab-9748-301ef17cf7da tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:41.117173 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-aba95f63-874b-46ab-9748-301ef17cf7da tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:41.118256 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-aba95f63-874b-46ab-9748-301ef17cf7da tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:41.118689 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-aba95f63-874b-46ab-9748-301ef17cf7da tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:41.147019 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-aba95f63-874b-46ab-9748-301ef17cf7da tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042712 Nov 08 16:22:41.147585 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 760/1513] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:22:41 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 16:22:41.230841 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e8a53460-395d-4c88-a0a6-061a3e50e015 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:41.231448 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e8a53460-395d-4c88-a0a6-061a3e50e015 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:41.238047 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e8a53460-395d-4c88-a0a6-061a3e50e015 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:41.238602 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e8a53460-395d-4c88-a0a6-061a3e50e015 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:41.239380 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e8a53460-395d-4c88-a0a6-061a3e50e015 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:41.239809 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e8a53460-395d-4c88-a0a6-061a3e50e015 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:41.245570 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f1e2a013-913d-4a70-9a52-bd71602f2600 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:41.246491 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f1e2a013-913d-4a70-9a52-bd71602f2600 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:41.252611 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f1e2a013-913d-4a70-9a52-bd71602f2600 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:41.253151 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f1e2a013-913d-4a70-9a52-bd71602f2600 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:41.253940 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f1e2a013-913d-4a70-9a52-bd71602f2600 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:41.254369 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f1e2a013-913d-4a70-9a52-bd71602f2600 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:41.283197 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f1e2a013-913d-4a70-9a52-bd71602f2600 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041479 Nov 08 16:22:41.283676 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 761/1514] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Nov 8 16:22:41 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 08 16:22:41.336240 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-28c3c8f8-4595-4434-9f16-6c3270c773a8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:41.336727 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-28c3c8f8-4595-4434-9f16-6c3270c773a8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:41.343056 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-28c3c8f8-4595-4434-9f16-6c3270c773a8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:41.343494 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-28c3c8f8-4595-4434-9f16-6c3270c773a8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:41.344257 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-28c3c8f8-4595-4434-9f16-6c3270c773a8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:41.344687 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-28c3c8f8-4595-4434-9f16-6c3270c773a8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:41.370289 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-28c3c8f8-4595-4434-9f16-6c3270c773a8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Going to try to terminate instance {{(pid=115523) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:22:41.375006 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e8a53460-395d-4c88-a0a6-061a3e50e015 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:41.382383 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e8a53460-395d-4c88-a0a6-061a3e50e015 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1446 microversion: 2.1 time: 0.155189 Nov 08 16:22:41.382940 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 754/1515] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:41 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1446 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:22:41.398274 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1931bef6-4a5c-41eb-8c0f-764f53e5d06a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:41.398871 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1931bef6-4a5c-41eb-8c0f-764f53e5d06a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:41.404835 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1931bef6-4a5c-41eb-8c0f-764f53e5d06a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:41.405249 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1931bef6-4a5c-41eb-8c0f-764f53e5d06a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:41.406181 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1931bef6-4a5c-41eb-8c0f-764f53e5d06a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:41.406718 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1931bef6-4a5c-41eb-8c0f-764f53e5d06a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:41.448850 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-28c3c8f8-4595-4434-9f16-6c3270c773a8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "DELETE /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b" status: 204 len: 0 microversion: 2.1 time: 0.115868 Nov 08 16:22:41.449444 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 762/1516] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:22:41 2021] DELETE /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 08 16:22:41.457917 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d65a3277-5341-417c-9a37-853adea26acc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:41.458816 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d65a3277-5341-417c-9a37-853adea26acc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:41.465004 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d65a3277-5341-417c-9a37-853adea26acc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:41.465457 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d65a3277-5341-417c-9a37-853adea26acc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:41.466311 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d65a3277-5341-417c-9a37-853adea26acc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:41.466748 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d65a3277-5341-417c-9a37-853adea26acc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:41.586200 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1931bef6-4a5c-41eb-8c0f-764f53e5d06a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:41.594069 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1931bef6-4a5c-41eb-8c0f-764f53e5d06a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1446 microversion: 2.1 time: 0.199232 Nov 08 16:22:41.594733 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 755/1517] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:41 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1446 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:22:41.631574 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-d65a3277-5341-417c-9a37-853adea26acc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:41.639044 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d65a3277-5341-417c-9a37-853adea26acc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b" status: 200 len: 1672 microversion: 2.1 time: 0.185090 Nov 08 16:22:41.639614 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 763/1518] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:41 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b => generated 1672 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:22:42.656329 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-26bb9f3a-2a13-49e5-a25d-f798958d318f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:42.656960 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-26bb9f3a-2a13-49e5-a25d-f798958d318f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:42.663503 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-26bb9f3a-2a13-49e5-a25d-f798958d318f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:42.664094 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-26bb9f3a-2a13-49e5-a25d-f798958d318f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:42.664887 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-26bb9f3a-2a13-49e5-a25d-f798958d318f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:42.665326 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-26bb9f3a-2a13-49e5-a25d-f798958d318f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:42.793890 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-26bb9f3a-2a13-49e5-a25d-f798958d318f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:42.801143 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-26bb9f3a-2a13-49e5-a25d-f798958d318f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b" status: 200 len: 1672 microversion: 2.1 time: 0.148624 Nov 08 16:22:42.801725 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 756/1519] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:42 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:22:43.195835 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-6a11d608-0466-45bf-955a-8ee4b86b87af req-738cdae0-34e4-4885-8612-d8375a87516a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "tag": "e8c812be-3317-46f0-9044-f415824262be"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:22:43.197327 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:22:43.197327 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:22:43.205073 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-6a11d608-0466-45bf-955a-8ee4b86b87af req-738cdae0-34e4-4885-8612-d8375a87516a service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:43.205512 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-6a11d608-0466-45bf-955a-8ee4b86b87af req-738cdae0-34e4-4885-8612-d8375a87516a service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:43.216549 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-6a11d608-0466-45bf-955a-8ee4b86b87af req-738cdae0-34e4-4885-8612-d8375a87516a service nova] Creating event network-changed:e8c812be-3317-46f0-9044-f415824262be for instance 8472eae0-c7a0-4a09-855d-0d96cce75e92 on hv-cinder-81618 Nov 08 16:22:43.221420 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-6a11d608-0466-45bf-955a-8ee4b86b87af req-738cdae0-34e4-4885-8612-d8375a87516a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029177 Nov 08 16:22:43.222282 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 764/1520] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:22:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:22:43.818662 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-dcc12bdb-225d-4c4d-b6fd-d58b3867a905 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:43.819213 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-dcc12bdb-225d-4c4d-b6fd-d58b3867a905 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:43.825485 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dcc12bdb-225d-4c4d-b6fd-d58b3867a905 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:43.825976 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dcc12bdb-225d-4c4d-b6fd-d58b3867a905 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:43.826779 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dcc12bdb-225d-4c4d-b6fd-d58b3867a905 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:43.827216 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-dcc12bdb-225d-4c4d-b6fd-d58b3867a905 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:43.966002 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-dcc12bdb-225d-4c4d-b6fd-d58b3867a905 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:43.973500 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-dcc12bdb-225d-4c4d-b6fd-d58b3867a905 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b" status: 200 len: 1672 microversion: 2.1 time: 0.158712 Nov 08 16:22:43.974465 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 757/1521] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:43 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:22:44.832231 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-5c8e7782-75b2-4572-8be0-7784f11bc151 req-812f7384-8c0f-4750-ad74-879d68b279fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c45dd64-42e8-48a5-8a86-f7ac61c15a2b", "name": "network-vif-deleted", "tag": "a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:22:44.833934 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:22:44.833934 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:22:44.841642 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-5c8e7782-75b2-4572-8be0-7784f11bc151 req-812f7384-8c0f-4750-ad74-879d68b279fa service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:44.842334 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-5c8e7782-75b2-4572-8be0-7784f11bc151 req-812f7384-8c0f-4750-ad74-879d68b279fa service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:44.853879 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-5c8e7782-75b2-4572-8be0-7784f11bc151 req-812f7384-8c0f-4750-ad74-879d68b279fa service nova] Creating event network-vif-deleted:a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 for instance 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b on hv-cinder-81618 Nov 08 16:22:44.859042 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-5c8e7782-75b2-4572-8be0-7784f11bc151 req-812f7384-8c0f-4750-ad74-879d68b279fa service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031512 Nov 08 16:22:44.859630 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 765/1522] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:22:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:22:44.990320 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4e4c79d3-2cda-448b-b860-ff5da10de19a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:44.990916 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4e4c79d3-2cda-448b-b860-ff5da10de19a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:44.999258 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4e4c79d3-2cda-448b-b860-ff5da10de19a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:44.999702 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4e4c79d3-2cda-448b-b860-ff5da10de19a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:45.000922 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4e4c79d3-2cda-448b-b860-ff5da10de19a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:45.002298 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4e4c79d3-2cda-448b-b860-ff5da10de19a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:45.035477 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4e4c79d3-2cda-448b-b860-ff5da10de19a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:45.036188 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4e4c79d3-2cda-448b-b860-ff5da10de19a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:45.036807 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.objects.instance [None req-4e4c79d3-2cda-448b-b860-ff5da10de19a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lazy-loading 'fault' on Instance uuid 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b {{(pid=115524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:22:45.077405 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-4e4c79d3-2cda-448b-b860-ff5da10de19a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3924bafb69cd45709eb3878837741eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:22:45.086071 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4e4c79d3-2cda-448b-b860-ff5da10de19a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b" status: 200 len: 1326 microversion: 2.1 time: 0.098945 Nov 08 16:22:45.086071 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 758/1523] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:44 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:22:46.102348 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-803aee12-c057-4f36-8935-af4e649bb603 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:46.103073 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-803aee12-c057-4f36-8935-af4e649bb603 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:46.109331 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-803aee12-c057-4f36-8935-af4e649bb603 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:46.109816 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-803aee12-c057-4f36-8935-af4e649bb603 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:46.111125 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-803aee12-c057-4f36-8935-af4e649bb603 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:46.111550 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-803aee12-c057-4f36-8935-af4e649bb603 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:46.124835 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-803aee12-c057-4f36-8935-af4e649bb603 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] HTTP exception thrown: Instance 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b could not be found. Nov 08 16:22:46.125444 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-803aee12-c057-4f36-8935-af4e649bb603 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Returning 404 to user: Instance 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:22:46.126867 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-803aee12-c057-4f36-8935-af4e649bb603 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b" status: 404 len: 111 microversion: 2.1 time: 0.028465 Nov 08 16:22:46.127391 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 766/1524] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:46 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:22:46.135304 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-49347927-3319-419c-8f9f-bb4629dc2ad5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '.version_select at 0x7f8c07633790>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:46.153769 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-49347927-3319-419c-8f9f-bb4629dc2ad5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-486914827" status: 202 len: 0 microversion: 2.1 time: 0.021978 Nov 08 16:22:46.154407 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 759/1525] 10.222.0.37 () {58 vars in 1217 bytes} [Mon Nov 8 16:22:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-486914827 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:22:47.763427 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 16:22:47.764082 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: Mon Nov 8 16:22:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 16:22:49.008370 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e363e648-16b0-43b8-a700-8d7a4811634f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:49.008949 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e363e648-16b0-43b8-a700-8d7a4811634f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:49.014967 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e363e648-16b0-43b8-a700-8d7a4811634f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:49.015402 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e363e648-16b0-43b8-a700-8d7a4811634f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:49.016153 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e363e648-16b0-43b8-a700-8d7a4811634f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:49.016574 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e363e648-16b0-43b8-a700-8d7a4811634f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:49.031103 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-e363e648-16b0-43b8-a700-8d7a4811634f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] HTTP exception thrown: Instance 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b could not be found. Nov 08 16:22:49.031704 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e363e648-16b0-43b8-a700-8d7a4811634f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Returning 404 to user: Instance 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:22:49.032528 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e363e648-16b0-43b8-a700-8d7a4811634f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "DELETE /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b" status: 404 len: 111 microversion: 2.1 time: 0.027800 Nov 08 16:22:49.033035 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 767/1526] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:22:49 2021] DELETE /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:22:49.040547 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-25df07e2-eaa0-4e9a-8f21-06dfd4ac4b09 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:49.041156 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-25df07e2-eaa0-4e9a-8f21-06dfd4ac4b09 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:49.048603 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-25df07e2-eaa0-4e9a-8f21-06dfd4ac4b09 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:49.049047 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-25df07e2-eaa0-4e9a-8f21-06dfd4ac4b09 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:49.049838 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-25df07e2-eaa0-4e9a-8f21-06dfd4ac4b09 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:49.050269 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-25df07e2-eaa0-4e9a-8f21-06dfd4ac4b09 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:49.062973 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-25df07e2-eaa0-4e9a-8f21-06dfd4ac4b09 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] HTTP exception thrown: Instance 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b could not be found. Nov 08 16:22:49.063804 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-25df07e2-eaa0-4e9a-8f21-06dfd4ac4b09 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Returning 404 to user: Instance 0c45dd64-42e8-48a5-8a86-f7ac61c15a2b could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:22:49.064788 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-25df07e2-eaa0-4e9a-8f21-06dfd4ac4b09 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b" status: 404 len: 111 microversion: 2.1 time: 0.027787 Nov 08 16:22:49.065756 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 760/1527] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:49 2021] GET /compute/v2.1/servers/0c45dd64-42e8-48a5-8a86-f7ac61c15a2b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:22:50.189436 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-789aa9e3-ed12-41e6-b5c5-3ae5a606e793 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:50.189959 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-789aa9e3-ed12-41e6-b5c5-3ae5a606e793 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:50.196103 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-789aa9e3-ed12-41e6-b5c5-3ae5a606e793 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:50.196545 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-789aa9e3-ed12-41e6-b5c5-3ae5a606e793 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:50.197315 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-789aa9e3-ed12-41e6-b5c5-3ae5a606e793 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:50.197763 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-789aa9e3-ed12-41e6-b5c5-3ae5a606e793 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:50.211032 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-789aa9e3-ed12-41e6-b5c5-3ae5a606e793 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] HTTP exception thrown: Instance b76ed94d-63f4-4597-be02-f3fc032b85aa could not be found. Nov 08 16:22:50.211600 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-789aa9e3-ed12-41e6-b5c5-3ae5a606e793 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Returning 404 to user: Instance b76ed94d-63f4-4597-be02-f3fc032b85aa could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:22:50.212435 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-789aa9e3-ed12-41e6-b5c5-3ae5a606e793 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "DELETE /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 404 len: 111 microversion: 2.1 time: 0.027124 Nov 08 16:22:50.212936 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 768/1528] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:22:50 2021] DELETE /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:22:50.220917 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-458c1810-0a65-420c-8163-bf46406a105d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:50.221526 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-458c1810-0a65-420c-8163-bf46406a105d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] [instance: b76ed94d-63f4-4597-be02-f3fc032b85aa] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:22:50.228175 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-458c1810-0a65-420c-8163-bf46406a105d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:50.228629 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-458c1810-0a65-420c-8163-bf46406a105d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:50.229407 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-458c1810-0a65-420c-8163-bf46406a105d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:22:50.230054 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-458c1810-0a65-420c-8163-bf46406a105d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:22:50.244034 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-458c1810-0a65-420c-8163-bf46406a105d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] HTTP exception thrown: Instance b76ed94d-63f4-4597-be02-f3fc032b85aa could not be found. Nov 08 16:22:50.244623 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-458c1810-0a65-420c-8163-bf46406a105d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Returning 404 to user: Instance b76ed94d-63f4-4597-be02-f3fc032b85aa could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:22:50.245474 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-458c1810-0a65-420c-8163-bf46406a105d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa" status: 404 len: 111 microversion: 2.1 time: 0.028706 Nov 08 16:22:50.246036 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 761/1529] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:22:50 2021] GET /compute/v2.1/servers/b76ed94d-63f4-4597-be02-f3fc032b85aa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:22:54.455007 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ba917458-173a-411f-8707-c4e97da75bb0 tempest-VolumesGetTestJSON-966614270 tempest-VolumesGetTestJSON-966614270-project] Action: 'create', calling method: .version_select at 0x7f8c074f55e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1955286581", "metadata": {"Type": "work"}}} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:22:54.717186 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ba917458-173a-411f-8707-c4e97da75bb0 tempest-VolumesGetTestJSON-966614270 tempest-VolumesGetTestJSON-966614270-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.369753 Nov 08 16:22:54.717824 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 769/1530] 10.222.0.37 () {60 vars in 1155 bytes} [Mon Nov 8 16:22:54 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 371 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 08 16:22:54.730282 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-9cdbb9b0-6edf-4a83-9dd3-fd5d6f9baf21 tempest-VolumesGetTestJSON-966614270 tempest-VolumesGetTestJSON-966614270-project] Calling method '.version_select at 0x7f8c076539d0>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:54.776792 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-9cdbb9b0-6edf-4a83-9dd3-fd5d6f9baf21 tempest-VolumesGetTestJSON-966614270 tempest-VolumesGetTestJSON-966614270-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/baa887e0-1495-4ebb-98ae-1ea461ed3993" status: 200 len: 353 microversion: 2.1 time: 0.049981 Nov 08 16:22:54.777354 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 762/1531] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Nov 8 16:22:54 2021] GET /compute/v2.1/os-volumes/baa887e0-1495-4ebb-98ae-1ea461ed3993 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:22:55.788911 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6075dfa9-96fe-46e0-be4c-123e557efb5f tempest-VolumesGetTestJSON-966614270 tempest-VolumesGetTestJSON-966614270-project] Calling method '.version_select at 0x7f8c0c92aca0>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:55.833901 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6075dfa9-96fe-46e0-be4c-123e557efb5f tempest-VolumesGetTestJSON-966614270 tempest-VolumesGetTestJSON-966614270-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/baa887e0-1495-4ebb-98ae-1ea461ed3993" status: 200 len: 354 microversion: 2.1 time: 0.049006 Nov 08 16:22:55.834483 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 770/1532] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Nov 8 16:22:55 2021] GET /compute/v2.1/os-volumes/baa887e0-1495-4ebb-98ae-1ea461ed3993 => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:22:55.845703 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-f1e95b2d-ae62-46fe-808c-a17c3b42b5c2 tempest-VolumesGetTestJSON-966614270 tempest-VolumesGetTestJSON-966614270-project] Calling method '.version_select at 0x7f8c0739f820>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:55.892274 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-f1e95b2d-ae62-46fe-808c-a17c3b42b5c2 tempest-VolumesGetTestJSON-966614270 tempest-VolumesGetTestJSON-966614270-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/baa887e0-1495-4ebb-98ae-1ea461ed3993" status: 200 len: 354 microversion: 2.1 time: 0.050557 Nov 08 16:22:55.892836 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 763/1533] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Nov 8 16:22:55 2021] GET /compute/v2.1/os-volumes/baa887e0-1495-4ebb-98ae-1ea461ed3993 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:22:55.903853 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f8d764e9-5292-4f9e-9725-651ac85fbc18 tempest-VolumesGetTestJSON-966614270 tempest-VolumesGetTestJSON-966614270-project] Calling method '.version_select at 0x7f8c0c92a550>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:55.960776 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f8d764e9-5292-4f9e-9725-651ac85fbc18 tempest-VolumesGetTestJSON-966614270 tempest-VolumesGetTestJSON-966614270-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/baa887e0-1495-4ebb-98ae-1ea461ed3993" status: 202 len: 0 microversion: 2.1 time: 0.060390 Nov 08 16:22:55.961341 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 771/1534] 10.222.0.37 () {58 vars in 1247 bytes} [Mon Nov 8 16:22:55 2021] DELETE /compute/v2.1/os-volumes/baa887e0-1495-4ebb-98ae-1ea461ed3993 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:22:55.969335 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4c69bdf4-beac-4201-b044-8d0ce6fc8a7e tempest-VolumesGetTestJSON-966614270 tempest-VolumesGetTestJSON-966614270-project] Calling method '.version_select at 0x7f8c072ff280>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:56.014805 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4c69bdf4-beac-4201-b044-8d0ce6fc8a7e tempest-VolumesGetTestJSON-966614270 tempest-VolumesGetTestJSON-966614270-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/baa887e0-1495-4ebb-98ae-1ea461ed3993" status: 200 len: 353 microversion: 2.1 time: 0.049124 Nov 08 16:22:56.015396 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 764/1535] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Nov 8 16:22:55 2021] GET /compute/v2.1/os-volumes/baa887e0-1495-4ebb-98ae-1ea461ed3993 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:22:57.027528 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ed323305-aae3-4fa0-a4c2-5d48e0788538 tempest-VolumesGetTestJSON-966614270 tempest-VolumesGetTestJSON-966614270-project] Calling method '.version_select at 0x7f8c07634670>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:57.054049 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-ed323305-aae3-4fa0-a4c2-5d48e0788538 tempest-VolumesGetTestJSON-966614270 tempest-VolumesGetTestJSON-966614270-project] HTTP exception thrown: Volume baa887e0-1495-4ebb-98ae-1ea461ed3993 could not be found. Nov 08 16:22:57.054634 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ed323305-aae3-4fa0-a4c2-5d48e0788538 tempest-VolumesGetTestJSON-966614270 tempest-VolumesGetTestJSON-966614270-project] Returning 404 to user: Volume baa887e0-1495-4ebb-98ae-1ea461ed3993 could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:22:57.055452 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ed323305-aae3-4fa0-a4c2-5d48e0788538 tempest-VolumesGetTestJSON-966614270 tempest-VolumesGetTestJSON-966614270-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/baa887e0-1495-4ebb-98ae-1ea461ed3993" status: 404 len: 109 microversion: 2.1 time: 0.032046 Nov 08 16:22:57.055973 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 772/1536] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Nov 8 16:22:57 2021] GET /compute/v2.1/os-volumes/baa887e0-1495-4ebb-98ae-1ea461ed3993 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:22:59.881279 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d88f229f-42b2-49ce-941e-0cbcc10b0501 tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] Calling method '.version_select at 0x7f8c07633c10>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:22:59.926661 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d88f229f-42b2-49ce-941e-0cbcc10b0501 tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/08ddad14-7489-4748-8cfa-bb160436d4c4" status: 200 len: 350 microversion: 2.1 time: 0.050751 Nov 08 16:22:59.927223 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 765/1537] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Nov 8 16:22:59 2021] GET /compute/v2.1/os-volumes/08ddad14-7489-4748-8cfa-bb160436d4c4 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:01.222793 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-86557f05-3041-4d91-88e4-caaa61ff7942 tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] Calling method '.version_select at 0x7f8c07634d30>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:01.267655 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-86557f05-3041-4d91-88e4-caaa61ff7942 tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/78a477f6-ba15-4b39-86ee-a3b60b7f938c" status: 200 len: 349 microversion: 2.1 time: 0.049390 Nov 08 16:23:01.268206 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 773/1538] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Nov 8 16:23:01 2021] GET /compute/v2.1/os-volumes/78a477f6-ba15-4b39-86ee-a3b60b7f938c => generated 349 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:02.560221 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d3473a67-f268-49b9-b2ae-8fd659f5343f tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] Calling method '.version_select at 0x7f8c0764be50>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:02.603981 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d3473a67-f268-49b9-b2ae-8fd659f5343f tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/902b8c1c-034d-4750-88c2-d15d3090eb9d" status: 200 len: 351 microversion: 2.1 time: 0.047762 Nov 08 16:23:02.604531 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 766/1539] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Nov 8 16:23:02 2021] GET /compute/v2.1/os-volumes/902b8c1c-034d-4750-88c2-d15d3090eb9d => generated 351 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:02.615840 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a51daf3c-f2ea-4ab1-a529-c7cc7cd54e77 tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] Calling method '.version_select at 0x7f8c076615e0>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:02.695001 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a51daf3c-f2ea-4ab1-a529-c7cc7cd54e77 tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] 10.222.0.37 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.083031 Nov 08 16:23:02.695564 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 774/1540] 10.222.0.37 () {58 vars in 1133 bytes} [Mon Nov 8 16:23:02 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:23:02.707227 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-afa966f3-e165-4f48-98e3-80c2e1a94f50 tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] Calling method '.version_select at 0x7f8c0764bee0>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:02.784338 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-afa966f3-e165-4f48-98e3-80c2e1a94f50 tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] 10.222.0.37 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.080706 Nov 08 16:23:02.784989 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 767/1541] 10.222.0.37 () {58 vars in 1148 bytes} [Mon Nov 8 16:23:02 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:02.796289 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ae867e1e-c011-4f40-af68-f07721a50628 tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] Calling method '.version_select at 0x7f8c105e63a0>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:02.872492 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ae867e1e-c011-4f40-af68-f07721a50628 tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] 10.222.0.37 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.079693 Nov 08 16:23:02.873044 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 775/1542] 10.222.0.37 () {58 vars in 1133 bytes} [Mon Nov 8 16:23:02 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:23:02.884166 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-12c7d0f7-6072-4ad7-b187-03b6439056f2 tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] Calling method '.version_select at 0x7f8c07731e50>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:02.961519 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-12c7d0f7-6072-4ad7-b187-03b6439056f2 tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] 10.222.0.37 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.081091 Nov 08 16:23:02.962133 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 768/1543] 10.222.0.37 () {58 vars in 1166 bytes} [Mon Nov 8 16:23:02 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:02.973961 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ff3a4e38-828b-40fe-94d7-0332ccf3cc39 tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] Calling method '.version_select at 0x7f8c0764f550>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:03.051426 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ff3a4e38-828b-40fe-94d7-0332ccf3cc39 tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.081644 Nov 08 16:23:03.051985 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 776/1544] 10.222.0.37 () {58 vars in 1169 bytes} [Mon Nov 8 16:23:02 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:03.063944 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-697e2158-51ae-4652-bf9a-9c6f47bee2d2 tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] Calling method '.version_select at 0x7f8c07652790>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:03.141331 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-697e2158-51ae-4652-bf9a-9c6f47bee2d2 tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.081373 Nov 08 16:23:03.142091 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 769/1545] 10.222.0.37 () {58 vars in 1154 bytes} [Mon Nov 8 16:23:03 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:23:03.152743 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b7eebf06-4401-41d0-a8f2-8a95be0628af tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] Calling method '.version_select at 0x7f8c10611ca0>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:03.240238 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b7eebf06-4401-41d0-a8f2-8a95be0628af tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.090979 Nov 08 16:23:03.240801 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 777/1546] 10.222.0.37 () {58 vars in 1187 bytes} [Mon Nov 8 16:23:03 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:03.252089 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d90e9cc9-e2db-4951-8548-1effc2d8f3b4 tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] Calling method '.version_select at 0x7f8c076525e0>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:03.330507 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d90e9cc9-e2db-4951-8548-1effc2d8f3b4 tempest-VolumesTestJSON-2145085188 tempest-VolumesTestJSON-2145085188-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.081908 Nov 08 16:23:03.331071 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 770/1547] 10.222.0.37 () {58 vars in 1154 bytes} [Mon Nov 8 16:23:03 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:23:33.165519 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-680a42b2-a80b-429a-89a3-31ab80a315c0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:33.166432 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-680a42b2-a80b-429a-89a3-31ab80a315c0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:33.172856 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-680a42b2-a80b-429a-89a3-31ab80a315c0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:33.173291 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-680a42b2-a80b-429a-89a3-31ab80a315c0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:33.174079 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-680a42b2-a80b-429a-89a3-31ab80a315c0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:33.174503 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-680a42b2-a80b-429a-89a3-31ab80a315c0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:33.204483 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-680a42b2-a80b-429a-89a3-31ab80a315c0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043020 Nov 08 16:23:33.205043 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 778/1548] 10.222.0.37 () {60 vars in 1342 bytes} [Mon Nov 8 16:23:33 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:23:33.260241 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:33.260755 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:33.267091 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:33.267537 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:33.268304 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:33.268735 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:33.292386 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Going to try to terminate instance {{(pid=115524) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:23:33.363265 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "DELETE /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 204 len: 0 microversion: 2.20 time: 0.107029 Nov 08 16:23:33.363765 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 771/1549] 10.222.0.37 () {60 vars in 1279 bytes} [Mon Nov 8 16:23:33 2021] DELETE /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 08 16:23:33.372332 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-44b15181-e13b-4df8-91d7-7716a100015f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:33.372933 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-44b15181-e13b-4df8-91d7-7716a100015f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:33.378879 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-44b15181-e13b-4df8-91d7-7716a100015f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:33.379320 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-44b15181-e13b-4df8-91d7-7716a100015f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:33.380085 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-44b15181-e13b-4df8-91d7-7716a100015f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:33.380517 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-44b15181-e13b-4df8-91d7-7716a100015f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:33.507016 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-44b15181-e13b-4df8-91d7-7716a100015f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:23:33.514726 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-44b15181-e13b-4df8-91d7-7716a100015f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:23:33.516714 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-44b15181-e13b-4df8-91d7-7716a100015f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:23:33.517907 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-44b15181-e13b-4df8-91d7-7716a100015f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1723 microversion: 2.20 time: 0.149574 Nov 08 16:23:33.518460 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 779/1550] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:23:33 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:23:34.536269 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-89694b25-404a-49c0-9952-43eaaf5da72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:34.536957 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-89694b25-404a-49c0-9952-43eaaf5da72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:34.543221 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-89694b25-404a-49c0-9952-43eaaf5da72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:34.543666 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-89694b25-404a-49c0-9952-43eaaf5da72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:34.544455 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-89694b25-404a-49c0-9952-43eaaf5da72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:34.544888 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-89694b25-404a-49c0-9952-43eaaf5da72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:34.676014 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-89694b25-404a-49c0-9952-43eaaf5da72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:23:34.683643 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-89694b25-404a-49c0-9952-43eaaf5da72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:23:34.685133 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-89694b25-404a-49c0-9952-43eaaf5da72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:23:34.686313 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-89694b25-404a-49c0-9952-43eaaf5da72c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1723 microversion: 2.20 time: 0.154178 Nov 08 16:23:34.686868 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 772/1551] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:23:34 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:23:35.704412 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-fc6e73b8-2e94-48d5-a250-6bf9378d92bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:35.705015 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fc6e73b8-2e94-48d5-a250-6bf9378d92bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:35.711491 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fc6e73b8-2e94-48d5-a250-6bf9378d92bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:35.711928 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fc6e73b8-2e94-48d5-a250-6bf9378d92bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:35.712724 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fc6e73b8-2e94-48d5-a250-6bf9378d92bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:35.713149 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fc6e73b8-2e94-48d5-a250-6bf9378d92bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:35.775606 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fc6e73b8-2e94-48d5-a250-6bf9378d92bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:23:35.786629 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fc6e73b8-2e94-48d5-a250-6bf9378d92bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:23:35.788112 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fc6e73b8-2e94-48d5-a250-6bf9378d92bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f2f258a03f24a94a7da462be24b1d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:23:35.789427 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-fc6e73b8-2e94-48d5-a250-6bf9378d92bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 200 len: 1656 microversion: 2.20 time: 0.088988 Nov 08 16:23:35.791594 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 780/1552] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:23:35 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 1656 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 16:23:36.030247 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-ab70c81f-dc6f-45d6-8d9d-f281bc6fb195 req-408ec76e-407d-492d-8101-60732dd29acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "name": "network-vif-deleted", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:23:36.032300 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:23:36.032300 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:23:36.039361 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-ab70c81f-dc6f-45d6-8d9d-f281bc6fb195 req-408ec76e-407d-492d-8101-60732dd29acf service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:36.039806 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-ab70c81f-dc6f-45d6-8d9d-f281bc6fb195 req-408ec76e-407d-492d-8101-60732dd29acf service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:36.057164 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-ab70c81f-dc6f-45d6-8d9d-f281bc6fb195 req-408ec76e-407d-492d-8101-60732dd29acf service nova] Creating event network-vif-deleted:b3094cea-72ef-41cf-ac88-a6d678f0fb09 for instance f0c4ded0-3419-458b-ab12-da310a2b2fd7 on hv-cinder-81618 Nov 08 16:23:36.067338 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-ab70c81f-dc6f-45d6-8d9d-f281bc6fb195 req-408ec76e-407d-492d-8101-60732dd29acf service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218361 Nov 08 16:23:36.070185 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 773/1553] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:23:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:36.808375 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-47d9b1e5-a16c-4d14-8e5b-35a15f550184 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:36.808982 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-47d9b1e5-a16c-4d14-8e5b-35a15f550184 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:36.817085 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-47d9b1e5-a16c-4d14-8e5b-35a15f550184 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:36.817727 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-47d9b1e5-a16c-4d14-8e5b-35a15f550184 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:36.819622 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-47d9b1e5-a16c-4d14-8e5b-35a15f550184 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:36.819622 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-47d9b1e5-a16c-4d14-8e5b-35a15f550184 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:36.842925 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-47d9b1e5-a16c-4d14-8e5b-35a15f550184 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] HTTP exception thrown: Instance f0c4ded0-3419-458b-ab12-da310a2b2fd7 could not be found. Nov 08 16:23:36.843530 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-47d9b1e5-a16c-4d14-8e5b-35a15f550184 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Returning 404 to user: Instance f0c4ded0-3419-458b-ab12-da310a2b2fd7 could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:23:36.844969 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-47d9b1e5-a16c-4d14-8e5b-35a15f550184 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 404 len: 111 microversion: 2.20 time: 0.039908 Nov 08 16:23:36.848691 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 781/1554] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Nov 8 16:23:36 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 08 16:23:36.852860 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a483f901-a9b6-43ce-894f-3bea2a02de0d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:36.853448 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a483f901-a9b6-43ce-894f-3bea2a02de0d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:36.858060 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6ebfc279-1f33-4e9f-8bf8-3e7e1ea0199b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '.version_select at 0x7f8c10556c10>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:36.866686 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a483f901-a9b6-43ce-894f-3bea2a02de0d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:36.867073 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a483f901-a9b6-43ce-894f-3bea2a02de0d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:36.868043 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a483f901-a9b6-43ce-894f-3bea2a02de0d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:36.868498 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a483f901-a9b6-43ce-894f-3bea2a02de0d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:36.880410 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6ebfc279-1f33-4e9f-8bf8-3e7e1ea0199b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-887846981" status: 204 len: 0 microversion: 2.20 time: 0.025923 Nov 08 16:23:36.881780 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 782/1555] 10.222.0.37 () {60 vars in 1258 bytes} [Mon Nov 8 16:23:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-887846981 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 08 16:23:36.893645 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-e123185d-dc04-4267-bc62-d1b45da25832 req-2e6669ef-e96b-4c95-aca2-f761f83b5c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f664b3dd-4458-4525-926a-1321ff188fdc", "tag": "ac61ca49-2eb1-4040-99b3-1fc5285b703f"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:23:36.895718 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:23:36.895718 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:23:36.896628 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a483f901-a9b6-43ce-894f-3bea2a02de0d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Going to try to terminate instance {{(pid=115524) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:23:36.905314 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-e123185d-dc04-4267-bc62-d1b45da25832 req-2e6669ef-e96b-4c95-aca2-f761f83b5c83 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:36.906139 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-e123185d-dc04-4267-bc62-d1b45da25832 req-2e6669ef-e96b-4c95-aca2-f761f83b5c83 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:36.919704 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-e123185d-dc04-4267-bc62-d1b45da25832 req-2e6669ef-e96b-4c95-aca2-f761f83b5c83 service nova] Creating event network-changed:ac61ca49-2eb1-4040-99b3-1fc5285b703f for instance f664b3dd-4458-4525-926a-1321ff188fdc on hv-cinder-81618 Nov 08 16:23:36.932223 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-e123185d-dc04-4267-bc62-d1b45da25832 req-2e6669ef-e96b-4c95-aca2-f761f83b5c83 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042641 Nov 08 16:23:36.933565 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 783/1556] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:23:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:37.008431 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a483f901-a9b6-43ce-894f-3bea2a02de0d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "DELETE /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 204 len: 0 microversion: 2.1 time: 0.159638 Nov 08 16:23:37.012822 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 774/1557] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:23:36 2021] DELETE /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:23:37.024183 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e0a42796-2037-4d08-a476-b82ef5d74ef2 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:37.025292 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e0a42796-2037-4d08-a476-b82ef5d74ef2 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:37.036599 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e0a42796-2037-4d08-a476-b82ef5d74ef2 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:37.039334 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e0a42796-2037-4d08-a476-b82ef5d74ef2 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:37.043231 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e0a42796-2037-4d08-a476-b82ef5d74ef2 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:37.045018 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e0a42796-2037-4d08-a476-b82ef5d74ef2 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:37.555543 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-e0a42796-2037-4d08-a476-b82ef5d74ef2 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:23:37.568554 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e0a42796-2037-4d08-a476-b82ef5d74ef2 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1578 microversion: 2.1 time: 0.550570 Nov 08 16:23:37.571154 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 784/1558] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:23:37 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1578 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:23:38.587416 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-62a91461-64ba-4155-843c-1e300ded40e8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:38.588112 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-62a91461-64ba-4155-843c-1e300ded40e8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:38.594938 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-62a91461-64ba-4155-843c-1e300ded40e8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:38.595576 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-62a91461-64ba-4155-843c-1e300ded40e8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:38.596287 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-62a91461-64ba-4155-843c-1e300ded40e8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:38.597014 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-62a91461-64ba-4155-843c-1e300ded40e8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:38.725578 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-62a91461-64ba-4155-843c-1e300ded40e8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:23:38.732803 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-62a91461-64ba-4155-843c-1e300ded40e8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1459 microversion: 2.1 time: 0.149527 Nov 08 16:23:38.733366 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 775/1559] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:23:38 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1459 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:23:38.789964 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-92623d06-6d0d-4c1c-a81c-28b80bac3aba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:38.790450 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-92623d06-6d0d-4c1c-a81c-28b80bac3aba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:38.796936 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-92623d06-6d0d-4c1c-a81c-28b80bac3aba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:38.797402 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-92623d06-6d0d-4c1c-a81c-28b80bac3aba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:38.798192 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-92623d06-6d0d-4c1c-a81c-28b80bac3aba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:38.798611 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-92623d06-6d0d-4c1c-a81c-28b80bac3aba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:38.811769 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-92623d06-6d0d-4c1c-a81c-28b80bac3aba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] HTTP exception thrown: Instance f0c4ded0-3419-458b-ab12-da310a2b2fd7 could not be found. Nov 08 16:23:38.812338 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-92623d06-6d0d-4c1c-a81c-28b80bac3aba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Returning 404 to user: Instance f0c4ded0-3419-458b-ab12-da310a2b2fd7 could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:23:38.813203 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-92623d06-6d0d-4c1c-a81c-28b80bac3aba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "DELETE /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 404 len: 111 microversion: 2.1 time: 0.026905 Nov 08 16:23:38.813703 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 785/1560] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:23:38 2021] DELETE /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:23:38.821206 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a003b458-b65c-4bb0-8669-a41cf8ac2562 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:38.821863 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a003b458-b65c-4bb0-8669-a41cf8ac2562 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: f0c4ded0-3419-458b-ab12-da310a2b2fd7] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:38.827747 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a003b458-b65c-4bb0-8669-a41cf8ac2562 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:38.828196 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a003b458-b65c-4bb0-8669-a41cf8ac2562 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:38.829459 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a003b458-b65c-4bb0-8669-a41cf8ac2562 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:38.829934 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a003b458-b65c-4bb0-8669-a41cf8ac2562 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:38.843039 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-a003b458-b65c-4bb0-8669-a41cf8ac2562 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] HTTP exception thrown: Instance f0c4ded0-3419-458b-ab12-da310a2b2fd7 could not be found. Nov 08 16:23:38.843563 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a003b458-b65c-4bb0-8669-a41cf8ac2562 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Returning 404 to user: Instance f0c4ded0-3419-458b-ab12-da310a2b2fd7 could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:23:38.845030 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a003b458-b65c-4bb0-8669-a41cf8ac2562 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7" status: 404 len: 111 microversion: 2.1 time: 0.026877 Nov 08 16:23:38.845582 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 776/1561] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:23:38 2021] GET /compute/v2.1/servers/f0c4ded0-3419-458b-ab12-da310a2b2fd7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:23:39.286712 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-4edf54a8-d03c-4807-8d46-d157316ae347 req-96fcfcd5-84b6-43b8-a13c-75f86408990c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f664b3dd-4458-4525-926a-1321ff188fdc", "name": "network-vif-deleted", "tag": "ac61ca49-2eb1-4040-99b3-1fc5285b703f"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:23:39.289240 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:23:39.289240 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:23:39.298772 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-4edf54a8-d03c-4807-8d46-d157316ae347 req-96fcfcd5-84b6-43b8-a13c-75f86408990c service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:39.299373 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-4edf54a8-d03c-4807-8d46-d157316ae347 req-96fcfcd5-84b6-43b8-a13c-75f86408990c service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:39.312202 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-4edf54a8-d03c-4807-8d46-d157316ae347 req-96fcfcd5-84b6-43b8-a13c-75f86408990c service nova] Creating event network-vif-deleted:ac61ca49-2eb1-4040-99b3-1fc5285b703f for instance f664b3dd-4458-4525-926a-1321ff188fdc on hv-cinder-81618 Nov 08 16:23:39.317846 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-4edf54a8-d03c-4807-8d46-d157316ae347 req-96fcfcd5-84b6-43b8-a13c-75f86408990c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036402 Nov 08 16:23:39.318422 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 786/1562] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:23:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:39.750831 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-1bf13e0f-b0ee-4245-a945-ccc6d918491c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:39.751454 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-1bf13e0f-b0ee-4245-a945-ccc6d918491c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:39.757773 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1bf13e0f-b0ee-4245-a945-ccc6d918491c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:39.758226 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1bf13e0f-b0ee-4245-a945-ccc6d918491c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:39.759003 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1bf13e0f-b0ee-4245-a945-ccc6d918491c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:39.759433 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1bf13e0f-b0ee-4245-a945-ccc6d918491c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:39.789045 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1bf13e0f-b0ee-4245-a945-ccc6d918491c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:39.789494 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-1bf13e0f-b0ee-4245-a945-ccc6d918491c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:39.789982 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.objects.instance [None req-1bf13e0f-b0ee-4245-a945-ccc6d918491c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lazy-loading 'fault' on Instance uuid f664b3dd-4458-4525-926a-1321ff188fdc {{(pid=115524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:23:39.828152 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-1bf13e0f-b0ee-4245-a945-ccc6d918491c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:23:39.835448 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-1bf13e0f-b0ee-4245-a945-ccc6d918491c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 200 len: 1231 microversion: 2.1 time: 0.088462 Nov 08 16:23:39.836005 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 777/1563] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:23:39 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 1231 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:23:39.975208 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-7f167e83-5320-48f5-9536-93e4542e48f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:39.975848 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-7f167e83-5320-48f5-9536-93e4542e48f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:39.983474 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7f167e83-5320-48f5-9536-93e4542e48f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:39.983895 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7f167e83-5320-48f5-9536-93e4542e48f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:39.985995 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7f167e83-5320-48f5-9536-93e4542e48f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:39.986488 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-7f167e83-5320-48f5-9536-93e4542e48f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:40.000134 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-7f167e83-5320-48f5-9536-93e4542e48f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] HTTP exception thrown: Instance 1c1c8c8d-5f78-45fb-803d-8f7a84df3433 could not be found. Nov 08 16:23:40.001330 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-7f167e83-5320-48f5-9536-93e4542e48f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Returning 404 to user: Instance 1c1c8c8d-5f78-45fb-803d-8f7a84df3433 could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:23:40.002120 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-7f167e83-5320-48f5-9536-93e4542e48f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "DELETE /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 404 len: 111 microversion: 2.1 time: 0.031454 Nov 08 16:23:40.002644 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 787/1564] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:23:39 2021] DELETE /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:23:40.010268 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0a0ec8db-5f7c-4761-8f6c-dc39ead84eee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:40.010888 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0a0ec8db-5f7c-4761-8f6c-dc39ead84eee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] [instance: 1c1c8c8d-5f78-45fb-803d-8f7a84df3433] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:40.017236 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0a0ec8db-5f7c-4761-8f6c-dc39ead84eee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:40.017681 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0a0ec8db-5f7c-4761-8f6c-dc39ead84eee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:40.018488 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0a0ec8db-5f7c-4761-8f6c-dc39ead84eee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:40.018919 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0a0ec8db-5f7c-4761-8f6c-dc39ead84eee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:40.031643 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-0a0ec8db-5f7c-4761-8f6c-dc39ead84eee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] HTTP exception thrown: Instance 1c1c8c8d-5f78-45fb-803d-8f7a84df3433 could not be found. Nov 08 16:23:40.032264 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0a0ec8db-5f7c-4761-8f6c-dc39ead84eee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Returning 404 to user: Instance 1c1c8c8d-5f78-45fb-803d-8f7a84df3433 could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:23:40.033067 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0a0ec8db-5f7c-4761-8f6c-dc39ead84eee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433" status: 404 len: 111 microversion: 2.1 time: 0.026430 Nov 08 16:23:40.033574 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 778/1565] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:23:40 2021] GET /compute/v2.1/servers/1c1c8c8d-5f78-45fb-803d-8f7a84df3433 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:23:40.852521 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f07e8c34-ad30-4079-a84c-6e7500ed83a9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:40.853116 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-f07e8c34-ad30-4079-a84c-6e7500ed83a9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: f664b3dd-4458-4525-926a-1321ff188fdc] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:40.858764 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f07e8c34-ad30-4079-a84c-6e7500ed83a9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:40.859461 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f07e8c34-ad30-4079-a84c-6e7500ed83a9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:40.860256 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f07e8c34-ad30-4079-a84c-6e7500ed83a9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:40.860679 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-f07e8c34-ad30-4079-a84c-6e7500ed83a9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:40.874559 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-f07e8c34-ad30-4079-a84c-6e7500ed83a9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] HTTP exception thrown: Instance f664b3dd-4458-4525-926a-1321ff188fdc could not be found. Nov 08 16:23:40.875160 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f07e8c34-ad30-4079-a84c-6e7500ed83a9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Returning 404 to user: Instance f664b3dd-4458-4525-926a-1321ff188fdc could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:23:40.876004 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f07e8c34-ad30-4079-a84c-6e7500ed83a9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc" status: 404 len: 111 microversion: 2.1 time: 0.027543 Nov 08 16:23:40.876524 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 788/1566] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:23:40 2021] GET /compute/v2.1/servers/f664b3dd-4458-4525-926a-1321ff188fdc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:23:44.128210 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-8268e07d-3a96-48a5-9b3b-323bcbe94fba tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:44.128744 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-57927f08-7bc4-4a84-9f70-fdf9360d673e req-02fcc919-bdfc-41bf-b866-01692df2d679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ce49cb3-8d64-40a5-9827-64fa1d2f37c2", "tag": "794847db-0663-47ab-a2b0-4bdedb698598"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:23:44.129780 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-8268e07d-3a96-48a5-9b3b-323bcbe94fba tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:44.130176 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:23:44.130176 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:23:44.137435 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-57927f08-7bc4-4a84-9f70-fdf9360d673e req-02fcc919-bdfc-41bf-b866-01692df2d679 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:44.137957 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-57927f08-7bc4-4a84-9f70-fdf9360d673e req-02fcc919-bdfc-41bf-b866-01692df2d679 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:44.138430 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8268e07d-3a96-48a5-9b3b-323bcbe94fba tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:44.138927 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8268e07d-3a96-48a5-9b3b-323bcbe94fba tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:44.139811 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8268e07d-3a96-48a5-9b3b-323bcbe94fba tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:44.140258 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8268e07d-3a96-48a5-9b3b-323bcbe94fba tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:44.156633 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-57927f08-7bc4-4a84-9f70-fdf9360d673e req-02fcc919-bdfc-41bf-b866-01692df2d679 service nova] Creating event network-changed:794847db-0663-47ab-a2b0-4bdedb698598 for instance 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 on hv-cinder-81618 Nov 08 16:23:44.166037 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-57927f08-7bc4-4a84-9f70-fdf9360d673e req-02fcc919-bdfc-41bf-b866-01692df2d679 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041027 Nov 08 16:23:44.166732 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 789/1567] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:23:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:44.180056 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-8268e07d-3a96-48a5-9b3b-323bcbe94fba tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Going to try to terminate instance {{(pid=115524) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:23:44.275673 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-8268e07d-3a96-48a5-9b3b-323bcbe94fba tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "DELETE /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 204 len: 0 microversion: 2.1 time: 0.152101 Nov 08 16:23:44.276381 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 779/1568] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:23:44 2021] DELETE /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:23:44.288299 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-a39d9b78-afc5-47d4-bbb1-19e93052cafa tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:44.289366 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-a39d9b78-afc5-47d4-bbb1-19e93052cafa tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:44.296483 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a39d9b78-afc5-47d4-bbb1-19e93052cafa tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:44.297254 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a39d9b78-afc5-47d4-bbb1-19e93052cafa tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:44.298839 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a39d9b78-afc5-47d4-bbb1-19e93052cafa tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:44.299741 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-a39d9b78-afc5-47d4-bbb1-19e93052cafa tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:44.514803 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-a39d9b78-afc5-47d4-bbb1-19e93052cafa tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:23:44.524585 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-a39d9b78-afc5-47d4-bbb1-19e93052cafa tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 200 len: 1577 microversion: 2.1 time: 0.241085 Nov 08 16:23:44.525619 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 790/1569] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:23:44 2021] GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 1577 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:23:44.597202 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5cadc815-a83d-456d-9fe9-7f79f2b0913c tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Action: 'create', calling method: .version_select at 0x7f8c0d194d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2047060608"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:23:44.903212 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5cadc815-a83d-456d-9fe9-7f79f2b0913c tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.447845 Nov 08 16:23:44.903912 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 780/1570] 10.222.0.37 () {60 vars in 1154 bytes} [Mon Nov 8 16:23:44 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 450 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 08 16:23:44.917065 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c99afbc5-4bce-4f28-8bb7-ac150579283f tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Calling method '.version_select at 0x7f8c0c03cb80>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:44.966648 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c99afbc5-4bce-4f28-8bb7-ac150579283f tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/36ac339e-50b8-470d-8670-87e85990979b" status: 200 len: 345 microversion: 2.1 time: 0.055255 Nov 08 16:23:44.967439 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 791/1571] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Nov 8 16:23:44 2021] GET /compute/v2.1/os-volumes/36ac339e-50b8-470d-8670-87e85990979b => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:45.542662 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5f39373d-c9cf-4dc6-9d60-582e1fa81665 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:45.543381 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5f39373d-c9cf-4dc6-9d60-582e1fa81665 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:45.550109 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5f39373d-c9cf-4dc6-9d60-582e1fa81665 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:45.550776 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5f39373d-c9cf-4dc6-9d60-582e1fa81665 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:45.551553 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5f39373d-c9cf-4dc6-9d60-582e1fa81665 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:45.551988 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5f39373d-c9cf-4dc6-9d60-582e1fa81665 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:45.615526 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-5f39373d-c9cf-4dc6-9d60-582e1fa81665 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a95f368744b3eb9fd85a9c6e0c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:23:45.623059 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5f39373d-c9cf-4dc6-9d60-582e1fa81665 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 200 len: 1225 microversion: 2.1 time: 0.084565 Nov 08 16:23:45.623622 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 781/1572] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:23:45 2021] GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:23:45.980527 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-c69d2920-2b6d-46ff-acb4-98ae8b14c58e tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Calling method '.version_select at 0x7f8c0c92a430>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:46.025231 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-c69d2920-2b6d-46ff-acb4-98ae8b14c58e tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/36ac339e-50b8-470d-8670-87e85990979b" status: 200 len: 346 microversion: 2.1 time: 0.048993 Nov 08 16:23:46.025812 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 792/1573] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Nov 8 16:23:45 2021] GET /compute/v2.1/os-volumes/36ac339e-50b8-470d-8670-87e85990979b => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:46.036322 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-6e08a77e-6ebc-41cc-9b68-383b8b862237 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Action: 'create', calling method: .version_select at 0x7f8c0c0b2820>, body: {"snapshot": {"volume_id": "36ac339e-50b8-470d-8670-87e85990979b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1821294353"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:23:46.182709 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-16f01697-78d1-4595-bf30-042e77dd6169 req-3d7fb718-41be-4429-9397-2e52144cad3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce49cb3-8d64-40a5-9827-64fa1d2f37c2", "name": "network-vif-deleted", "tag": "794847db-0663-47ab-a2b0-4bdedb698598"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:23:46.184412 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:23:46.184412 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:23:46.193138 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-16f01697-78d1-4595-bf30-042e77dd6169 req-3d7fb718-41be-4429-9397-2e52144cad3d service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:46.193494 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-16f01697-78d1-4595-bf30-042e77dd6169 req-3d7fb718-41be-4429-9397-2e52144cad3d service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:46.195940 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-6e08a77e-6ebc-41cc-9b68-383b8b862237 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] 10.222.0.37 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.163188 Nov 08 16:23:46.196778 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 782/1574] 10.222.0.37 () {60 vars in 1161 bytes} [Mon Nov 8 16:23:46 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:46.206859 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-8b25b5ce-776e-443d-82fd-c54be312e2a5 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Calling method '.version_select at 0x7f8c07653550>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:46.209986 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-16f01697-78d1-4595-bf30-042e77dd6169 req-3d7fb718-41be-4429-9397-2e52144cad3d service nova] Creating event network-vif-deleted:794847db-0663-47ab-a2b0-4bdedb698598 for instance 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 on hv-cinder-81618 Nov 08 16:23:46.216067 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-16f01697-78d1-4595-bf30-042e77dd6169 req-3d7fb718-41be-4429-9397-2e52144cad3d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037051 Nov 08 16:23:46.218349 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 793/1575] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:23:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:23:46.236247 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-8b25b5ce-776e-443d-82fd-c54be312e2a5 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/ba7dabe0-8eb0-4cd3-99b4-100c18755a31" status: 200 len: 287 microversion: 2.1 time: 0.033364 Nov 08 16:23:46.236822 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 783/1576] 10.222.0.37 () {58 vars in 1250 bytes} [Mon Nov 8 16:23:46 2021] GET /compute/v2.1/os-snapshots/ba7dabe0-8eb0-4cd3-99b4-100c18755a31 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:46.247000 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-54474f98-6044-46d1-9e44-8c52d635ecdd tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Calling method '.version_select at 0x7f8c10613ee0>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:46.275661 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-54474f98-6044-46d1-9e44-8c52d635ecdd tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.032726 Nov 08 16:23:46.276205 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 794/1577] 10.222.0.37 () {58 vars in 1139 bytes} [Mon Nov 8 16:23:46 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:46.286295 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ac23062a-0841-4f71-83d0-478a15068f81 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Calling method '.version_select at 0x7f8c0764be50>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:46.314053 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ac23062a-0841-4f71-83d0-478a15068f81 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/ba7dabe0-8eb0-4cd3-99b4-100c18755a31" status: 200 len: 287 microversion: 2.1 time: 0.031826 Nov 08 16:23:46.314605 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 784/1578] 10.222.0.37 () {58 vars in 1250 bytes} [Mon Nov 8 16:23:46 2021] GET /compute/v2.1/os-snapshots/ba7dabe0-8eb0-4cd3-99b4-100c18755a31 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:46.639211 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3b4f7b11-62db-4e31-bd49-c5237299fbda tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:46.639843 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-3b4f7b11-62db-4e31-bd49-c5237299fbda tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:46.646511 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3b4f7b11-62db-4e31-bd49-c5237299fbda tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:46.646945 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3b4f7b11-62db-4e31-bd49-c5237299fbda tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:46.647698 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3b4f7b11-62db-4e31-bd49-c5237299fbda tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:46.648119 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-3b4f7b11-62db-4e31-bd49-c5237299fbda tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:46.661222 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-3b4f7b11-62db-4e31-bd49-c5237299fbda tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] HTTP exception thrown: Instance 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 could not be found. Nov 08 16:23:46.661828 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-3b4f7b11-62db-4e31-bd49-c5237299fbda tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Returning 404 to user: Instance 5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:23:46.662637 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-3b4f7b11-62db-4e31-bd49-c5237299fbda tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2" status: 404 len: 111 microversion: 2.1 time: 0.027347 Nov 08 16:23:46.663155 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 795/1579] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:23:46 2021] GET /compute/v2.1/servers/5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:23:47.091786 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4a58c37e-7d07-4f16-a7ee-f8f831860273 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:47.092308 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-4a58c37e-7d07-4f16-a7ee-f8f831860273 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:47.098278 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a58c37e-7d07-4f16-a7ee-f8f831860273 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:47.098721 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a58c37e-7d07-4f16-a7ee-f8f831860273 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:47.099491 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a58c37e-7d07-4f16-a7ee-f8f831860273 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:47.099920 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-4a58c37e-7d07-4f16-a7ee-f8f831860273 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:47.113151 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-4a58c37e-7d07-4f16-a7ee-f8f831860273 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] HTTP exception thrown: Instance d643b8f8-c205-49ba-8889-30842481b95f could not be found. Nov 08 16:23:47.113755 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-4a58c37e-7d07-4f16-a7ee-f8f831860273 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Returning 404 to user: Instance d643b8f8-c205-49ba-8889-30842481b95f could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:23:47.114580 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-4a58c37e-7d07-4f16-a7ee-f8f831860273 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "DELETE /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 404 len: 111 microversion: 2.1 time: 0.027025 Nov 08 16:23:47.115102 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 785/1580] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:23:47 2021] DELETE /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:23:47.123265 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-cccd0ee6-6ee2-4b33-a975-d8b5ffbb33b7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:47.123869 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-cccd0ee6-6ee2-4b33-a975-d8b5ffbb33b7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] [instance: d643b8f8-c205-49ba-8889-30842481b95f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:23:47.129763 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cccd0ee6-6ee2-4b33-a975-d8b5ffbb33b7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:47.130212 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cccd0ee6-6ee2-4b33-a975-d8b5ffbb33b7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:47.130973 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cccd0ee6-6ee2-4b33-a975-d8b5ffbb33b7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:23:47.131401 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cccd0ee6-6ee2-4b33-a975-d8b5ffbb33b7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:23:47.144236 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-cccd0ee6-6ee2-4b33-a975-d8b5ffbb33b7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] HTTP exception thrown: Instance d643b8f8-c205-49ba-8889-30842481b95f could not be found. Nov 08 16:23:47.144804 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-cccd0ee6-6ee2-4b33-a975-d8b5ffbb33b7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Returning 404 to user: Instance d643b8f8-c205-49ba-8889-30842481b95f could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:23:47.145604 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-cccd0ee6-6ee2-4b33-a975-d8b5ffbb33b7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f" status: 404 len: 111 microversion: 2.1 time: 0.026002 Nov 08 16:23:47.146143 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 796/1581] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:23:47 2021] GET /compute/v2.1/servers/d643b8f8-c205-49ba-8889-30842481b95f => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 08 16:23:47.325151 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a2772b8f-e40b-4a56-a84a-bc02ff8496d0 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Calling method '.version_select at 0x7f8c0c0b29d0>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:47.353831 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a2772b8f-e40b-4a56-a84a-bc02ff8496d0 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/ba7dabe0-8eb0-4cd3-99b4-100c18755a31" status: 200 len: 287 microversion: 2.1 time: 0.032178 Nov 08 16:23:47.354361 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 786/1582] 10.222.0.37 () {58 vars in 1250 bytes} [Mon Nov 8 16:23:47 2021] GET /compute/v2.1/os-snapshots/ba7dabe0-8eb0-4cd3-99b4-100c18755a31 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:48.364242 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-fe03ffba-4862-4992-9ab2-42e307af6a50 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Calling method '.version_select at 0x7f8c106138b0>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:48.392707 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-fe03ffba-4862-4992-9ab2-42e307af6a50 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/ba7dabe0-8eb0-4cd3-99b4-100c18755a31" status: 200 len: 287 microversion: 2.1 time: 0.032092 Nov 08 16:23:48.393248 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 797/1583] 10.222.0.37 () {58 vars in 1250 bytes} [Mon Nov 8 16:23:48 2021] GET /compute/v2.1/os-snapshots/ba7dabe0-8eb0-4cd3-99b4-100c18755a31 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:49.404356 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bdc2dea3-af36-40c1-b0f6-6ecabc5fef37 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Calling method '.version_select at 0x7f8c0c0ce280>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:49.431618 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bdc2dea3-af36-40c1-b0f6-6ecabc5fef37 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/ba7dabe0-8eb0-4cd3-99b4-100c18755a31" status: 200 len: 287 microversion: 2.1 time: 0.031371 Nov 08 16:23:49.432188 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 787/1584] 10.222.0.37 () {58 vars in 1250 bytes} [Mon Nov 8 16:23:49 2021] GET /compute/v2.1/os-snapshots/ba7dabe0-8eb0-4cd3-99b4-100c18755a31 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:50.443794 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-778058a2-e138-44ed-93f8-51de45145623 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Calling method '.version_select at 0x7f8c07634040>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:50.472843 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-778058a2-e138-44ed-93f8-51de45145623 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/ba7dabe0-8eb0-4cd3-99b4-100c18755a31" status: 200 len: 288 microversion: 2.1 time: 0.033137 Nov 08 16:23:50.473397 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 798/1585] 10.222.0.37 () {58 vars in 1250 bytes} [Mon Nov 8 16:23:50 2021] GET /compute/v2.1/os-snapshots/ba7dabe0-8eb0-4cd3-99b4-100c18755a31 => generated 288 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:50.483730 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-2d0484d1-2d96-445b-adcf-d2950cf31087 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Calling method '.version_select at 0x7f8c07652280>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:50.522202 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-b7446ba1-c446-40de-94d9-1649ed01f4ae tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling method '.version_select at 0x7f8c10557ee0>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:50.542745 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-b7446ba1-c446-40de-94d9-1649ed01f4ae tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1157858539" status: 202 len: 0 microversion: 2.1 time: 0.024155 Nov 08 16:23:50.547928 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 799/1586] 10.222.0.37 () {58 vars in 1262 bytes} [Mon Nov 8 16:23:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1157858539 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 08 16:23:50.549161 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-2d0484d1-2d96-445b-adcf-d2950cf31087 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] 10.222.0.37 "DELETE /compute/v2.1/os-snapshots/ba7dabe0-8eb0-4cd3-99b4-100c18755a31" status: 202 len: 0 microversion: 2.1 time: 0.068796 Nov 08 16:23:50.549289 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 788/1587] 10.222.0.37 () {58 vars in 1253 bytes} [Mon Nov 8 16:23:50 2021] DELETE /compute/v2.1/os-snapshots/ba7dabe0-8eb0-4cd3-99b4-100c18755a31 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:23:50.559908 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e354da64-2789-4843-8996-a2167a209068 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Calling method '.version_select at 0x7f8c10613280>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:50.596541 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e354da64-2789-4843-8996-a2167a209068 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/ba7dabe0-8eb0-4cd3-99b4-100c18755a31" status: 200 len: 287 microversion: 2.1 time: 0.040184 Nov 08 16:23:50.597093 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 800/1588] 10.222.0.37 () {58 vars in 1250 bytes} [Mon Nov 8 16:23:50 2021] GET /compute/v2.1/os-snapshots/ba7dabe0-8eb0-4cd3-99b4-100c18755a31 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:51.608667 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-11407e91-4965-4d46-a181-9913fc872474 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Calling method '.version_select at 0x7f8c07633f70>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:51.634467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-11407e91-4965-4d46-a181-9913fc872474 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] HTTP exception thrown: Snapshot ba7dabe0-8eb0-4cd3-99b4-100c18755a31 could not be found. Nov 08 16:23:51.635065 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-11407e91-4965-4d46-a181-9913fc872474 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Returning 404 to user: Snapshot ba7dabe0-8eb0-4cd3-99b4-100c18755a31 could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:23:51.635892 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-11407e91-4965-4d46-a181-9913fc872474 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/ba7dabe0-8eb0-4cd3-99b4-100c18755a31" status: 404 len: 111 microversion: 2.1 time: 0.031508 Nov 08 16:23:51.636434 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 789/1589] 10.222.0.37 () {58 vars in 1250 bytes} [Mon Nov 8 16:23:51 2021] GET /compute/v2.1/os-snapshots/ba7dabe0-8eb0-4cd3-99b4-100c18755a31 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:23:51.644939 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f8c28528-eba3-4507-b532-1a2c80719a17 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Calling method '.version_select at 0x7f8c074f5430>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:51.707553 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f8c28528-eba3-4507-b532-1a2c80719a17 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/36ac339e-50b8-470d-8670-87e85990979b" status: 202 len: 0 microversion: 2.1 time: 0.066642 Nov 08 16:23:51.708209 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 801/1590] 10.222.0.37 () {58 vars in 1247 bytes} [Mon Nov 8 16:23:51 2021] DELETE /compute/v2.1/os-volumes/36ac339e-50b8-470d-8670-87e85990979b => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:23:51.716743 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-7d1539f0-e41b-453d-9621-8f00893fa6f6 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Calling method '.version_select at 0x7f8c0c0975e0>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:51.765015 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-7d1539f0-e41b-453d-9621-8f00893fa6f6 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/36ac339e-50b8-470d-8670-87e85990979b" status: 200 len: 345 microversion: 2.1 time: 0.052109 Nov 08 16:23:51.765592 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 790/1591] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Nov 8 16:23:51 2021] GET /compute/v2.1/os-volumes/36ac339e-50b8-470d-8670-87e85990979b => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:23:52.777859 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9ca50817-937f-4bc9-868e-11d67055716b tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Calling method '.version_select at 0x7f8c0c92a310>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:52.811960 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-9ca50817-937f-4bc9-868e-11d67055716b tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] HTTP exception thrown: Volume 36ac339e-50b8-470d-8670-87e85990979b could not be found. Nov 08 16:23:52.812884 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-9ca50817-937f-4bc9-868e-11d67055716b tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Returning 404 to user: Volume 36ac339e-50b8-470d-8670-87e85990979b could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:23:52.813866 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-9ca50817-937f-4bc9-868e-11d67055716b tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/36ac339e-50b8-470d-8670-87e85990979b" status: 404 len: 109 microversion: 2.1 time: 0.040818 Nov 08 16:23:52.821785 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 802/1592] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Nov 8 16:23:52 2021] GET /compute/v2.1/os-volumes/36ac339e-50b8-470d-8670-87e85990979b => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:23:52.831588 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3026a23e-57b3-4398-a7d7-9ce2779a12d5 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Calling method '.version_select at 0x7f8c0c032a60>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:52.859209 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-3026a23e-57b3-4398-a7d7-9ce2779a12d5 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] HTTP exception thrown: Volume 36ac339e-50b8-470d-8670-87e85990979b could not be found. Nov 08 16:23:52.859881 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3026a23e-57b3-4398-a7d7-9ce2779a12d5 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Returning 404 to user: Volume 36ac339e-50b8-470d-8670-87e85990979b could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:23:52.860710 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3026a23e-57b3-4398-a7d7-9ce2779a12d5 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/36ac339e-50b8-470d-8670-87e85990979b" status: 404 len: 109 microversion: 2.1 time: 0.034714 Nov 08 16:23:52.861241 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 791/1593] 10.222.0.37 () {58 vars in 1247 bytes} [Mon Nov 8 16:23:52 2021] DELETE /compute/v2.1/os-volumes/36ac339e-50b8-470d-8670-87e85990979b => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 08 16:23:52.869600 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-faa11b5b-c403-4c9f-9e85-e2c3dfc87ce2 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Calling method '.version_select at 0x7f8c074e7820>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:23:52.897665 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-faa11b5b-c403-4c9f-9e85-e2c3dfc87ce2 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] HTTP exception thrown: Volume 36ac339e-50b8-470d-8670-87e85990979b could not be found. Nov 08 16:23:52.898318 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-faa11b5b-c403-4c9f-9e85-e2c3dfc87ce2 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] Returning 404 to user: Volume 36ac339e-50b8-470d-8670-87e85990979b could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:23:52.899188 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-faa11b5b-c403-4c9f-9e85-e2c3dfc87ce2 tempest-VolumesSnapshotsTestJSON-2031041469 tempest-VolumesSnapshotsTestJSON-2031041469-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/36ac339e-50b8-470d-8670-87e85990979b" status: 404 len: 109 microversion: 2.1 time: 0.033955 Nov 08 16:23:52.899753 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 803/1594] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Nov 8 16:23:52 2021] GET /compute/v2.1/os-volumes/36ac339e-50b8-470d-8670-87e85990979b => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:24:23.721080 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-69c20c96-47b5-4a91-ae02-2baf275c278d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1405358624", "imageRef": "9abeafba-e602-4e0a-aab2-62160562de06", "flavorRef": "452"}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:24:23.771729 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.network.neutron [None req-69c20c96-47b5-4a91-ae02-2baf275c278d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] validate_networks() for None {{(pid=115524) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 16:24:24.053482 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-69c20c96-47b5-4a91-ae02-2baf275c278d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Flavor limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 16:24:24.053939 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-69c20c96-47b5-4a91-ae02-2baf275c278d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Image limits 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 16:24:24.054415 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-69c20c96-47b5-4a91-ae02-2baf275c278d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Flavor pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 16:24:24.054831 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-69c20c96-47b5-4a91-ae02-2baf275c278d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Image pref 0:0:0 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 16:24:24.055243 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.virt.hardware [None req-69c20c96-47b5-4a91-ae02-2baf275c278d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 16:24:24.064120 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-69c20c96-47b5-4a91-ae02-2baf275c278d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:24.064566 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-69c20c96-47b5-4a91-ae02-2baf275c278d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:24.065377 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-69c20c96-47b5-4a91-ae02-2baf275c278d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:24.065857 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-69c20c96-47b5-4a91-ae02-2baf275c278d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:24.082473 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-69c20c96-47b5-4a91-ae02-2baf275c278d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Getting quotas for project ad26288dfab54e44b0ef67b8ee1277bf. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 16:24:24.086322 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.quota [None req-69c20c96-47b5-4a91-ae02-2baf275c278d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Getting quotas for user 8ae861c65a30450da54380e615298822 and project ad26288dfab54e44b0ef67b8ee1277bf. Resources: {'instances', 'ram', 'cores'} {{(pid=115524) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 16:24:24.096582 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-69c20c96-47b5-4a91-ae02-2baf275c278d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Going to run 1 instances... {{(pid=115524) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 16:24:24.098920 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-69c20c96-47b5-4a91-ae02-2baf275c278d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9abeafba-e602-4e0a-aab2-62160562de06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 16:24:24.142213 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-69c20c96-47b5-4a91-ae02-2baf275c278d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.425867 Nov 08 16:24:24.142935 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 792/1595] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Nov 8 16:24:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 16:24:24.160227 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-41de6174-16d2-4542-b1dd-54557c3ad45d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:24:24.161251 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-41de6174-16d2-4542-b1dd-54557c3ad45d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:24:24.446143 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-41de6174-16d2-4542-b1dd-54557c3ad45d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae861c65a30450da54380e615298822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad26288dfab54e44b0ef67b8ee1277bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:24:24.453794 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-41de6174-16d2-4542-b1dd-54557c3ad45d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f" status: 200 len: 1215 microversion: 2.1 time: 0.298297 Nov 08 16:24:24.454350 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 804/1596] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:24:24 2021] GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f => generated 1215 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:24:25.470665 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-26fd5c82-1a94-42e1-a193-e7a814d36f7b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:24:25.471209 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-26fd5c82-1a94-42e1-a193-e7a814d36f7b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:24:25.520692 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-26fd5c82-1a94-42e1-a193-e7a814d36f7b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae861c65a30450da54380e615298822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad26288dfab54e44b0ef67b8ee1277bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:24:25.527030 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-26fd5c82-1a94-42e1-a193-e7a814d36f7b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f" status: 200 len: 1215 microversion: 2.1 time: 0.060743 Nov 08 16:24:25.527587 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 793/1597] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:24:25 2021] GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f => generated 1215 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:24:26.543949 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4534eb94-8111-4a85-ac38-2f1fa0471cc3 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:24:26.544547 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4534eb94-8111-4a85-ac38-2f1fa0471cc3 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:24:26.594025 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4534eb94-8111-4a85-ac38-2f1fa0471cc3 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae861c65a30450da54380e615298822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad26288dfab54e44b0ef67b8ee1277bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:24:26.600471 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4534eb94-8111-4a85-ac38-2f1fa0471cc3 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f" status: 200 len: 1215 microversion: 2.1 time: 0.060156 Nov 08 16:24:26.601021 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 805/1598] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:24:26 2021] GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f => generated 1215 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:24:27.617203 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-6d1187ed-7c60-478f-b5d0-3239e3a337f7 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:24:27.617837 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-6d1187ed-7c60-478f-b5d0-3239e3a337f7 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:24:27.625568 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6d1187ed-7c60-478f-b5d0-3239e3a337f7 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:27.626037 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6d1187ed-7c60-478f-b5d0-3239e3a337f7 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:27.626801 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6d1187ed-7c60-478f-b5d0-3239e3a337f7 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:27.627232 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-6d1187ed-7c60-478f-b5d0-3239e3a337f7 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:27.685024 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-6d1187ed-7c60-478f-b5d0-3239e3a337f7 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae861c65a30450da54380e615298822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad26288dfab54e44b0ef67b8ee1277bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:24:27.692640 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-6d1187ed-7c60-478f-b5d0-3239e3a337f7 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f" status: 200 len: 1219 microversion: 2.1 time: 0.079093 Nov 08 16:24:27.693194 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 794/1599] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:24:27 2021] GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:24:28.709552 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6029c0f3-cac1-41c4-ab81-e86bd6246734 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:24:28.710229 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6029c0f3-cac1-41c4-ab81-e86bd6246734 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:24:28.717288 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6029c0f3-cac1-41c4-ab81-e86bd6246734 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:28.717751 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6029c0f3-cac1-41c4-ab81-e86bd6246734 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:28.718535 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6029c0f3-cac1-41c4-ab81-e86bd6246734 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:28.718962 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6029c0f3-cac1-41c4-ab81-e86bd6246734 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:28.779966 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6029c0f3-cac1-41c4-ab81-e86bd6246734 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae861c65a30450da54380e615298822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad26288dfab54e44b0ef67b8ee1277bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:24:28.787162 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6029c0f3-cac1-41c4-ab81-e86bd6246734 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f" status: 200 len: 1211 microversion: 2.1 time: 0.081285 Nov 08 16:24:28.787739 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 806/1600] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:24:28 2021] GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:24:29.803928 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-8f95ae10-3026-48d3-9000-fbe869162e01 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:24:29.804536 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-8f95ae10-3026-48d3-9000-fbe869162e01 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:24:29.810880 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8f95ae10-3026-48d3-9000-fbe869162e01 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:29.811331 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8f95ae10-3026-48d3-9000-fbe869162e01 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:29.812128 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8f95ae10-3026-48d3-9000-fbe869162e01 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:29.813105 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8f95ae10-3026-48d3-9000-fbe869162e01 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:29.891728 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-8f95ae10-3026-48d3-9000-fbe869162e01 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae861c65a30450da54380e615298822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad26288dfab54e44b0ef67b8ee1277bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:24:29.898997 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-8f95ae10-3026-48d3-9000-fbe869162e01 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f" status: 200 len: 1273 microversion: 2.1 time: 0.098762 Nov 08 16:24:29.899576 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 795/1601] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:24:29 2021] GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:24:30.842028 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-bc61d35c-d1da-4cf7-8c1a-f1baacda537d req-eb206bc0-34fe-443d-8561-95f9ecae6386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "184e206e-40e2-43b8-bcd2-e7da4021a70f", "tag": "253b06d3-fdef-4152-8be6-3b6d31dc4c2a"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:24:30.844033 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:24:30.844033 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:24:30.852948 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-bc61d35c-d1da-4cf7-8c1a-f1baacda537d req-eb206bc0-34fe-443d-8561-95f9ecae6386 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:30.853388 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-bc61d35c-d1da-4cf7-8c1a-f1baacda537d req-eb206bc0-34fe-443d-8561-95f9ecae6386 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:30.875130 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-bc61d35c-d1da-4cf7-8c1a-f1baacda537d req-eb206bc0-34fe-443d-8561-95f9ecae6386 service nova] Creating event network-changed:253b06d3-fdef-4152-8be6-3b6d31dc4c2a for instance 184e206e-40e2-43b8-bcd2-e7da4021a70f on hv-cinder-81618 Nov 08 16:24:30.880572 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-bc61d35c-d1da-4cf7-8c1a-f1baacda537d req-eb206bc0-34fe-443d-8561-95f9ecae6386 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043647 Nov 08 16:24:30.881165 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 807/1602] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:24:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:24:30.916299 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a227d82d-eeb8-4e38-a897-6e57ae61dd9d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:24:30.916914 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a227d82d-eeb8-4e38-a897-6e57ae61dd9d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:24:30.924220 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a227d82d-eeb8-4e38-a897-6e57ae61dd9d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:30.925346 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a227d82d-eeb8-4e38-a897-6e57ae61dd9d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:30.926225 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a227d82d-eeb8-4e38-a897-6e57ae61dd9d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:30.930771 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a227d82d-eeb8-4e38-a897-6e57ae61dd9d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:31.147789 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a227d82d-eeb8-4e38-a897-6e57ae61dd9d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae861c65a30450da54380e615298822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad26288dfab54e44b0ef67b8ee1277bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:24:31.154990 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a227d82d-eeb8-4e38-a897-6e57ae61dd9d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f" status: 200 len: 1315 microversion: 2.1 time: 0.242455 Nov 08 16:24:31.155724 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 796/1603] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:24:30 2021] GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:24:32.173301 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-01a39449-4749-4754-ba0e-7c2a5aa29505 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:24:32.174017 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-01a39449-4749-4754-ba0e-7c2a5aa29505 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:24:32.180111 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-01a39449-4749-4754-ba0e-7c2a5aa29505 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:32.180560 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-01a39449-4749-4754-ba0e-7c2a5aa29505 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:32.181331 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-01a39449-4749-4754-ba0e-7c2a5aa29505 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:32.181785 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-01a39449-4749-4754-ba0e-7c2a5aa29505 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:32.314162 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-01a39449-4749-4754-ba0e-7c2a5aa29505 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae861c65a30450da54380e615298822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad26288dfab54e44b0ef67b8ee1277bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:24:32.321269 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-01a39449-4749-4754-ba0e-7c2a5aa29505 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f" status: 200 len: 1315 microversion: 2.1 time: 0.153111 Nov 08 16:24:32.321855 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 808/1604] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:24:32 2021] GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:24:33.338413 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-3a76ac33-c05a-477c-b3eb-1aef192a1814 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:24:33.338947 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-3a76ac33-c05a-477c-b3eb-1aef192a1814 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:24:33.345689 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3a76ac33-c05a-477c-b3eb-1aef192a1814 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:33.346168 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3a76ac33-c05a-477c-b3eb-1aef192a1814 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:33.346933 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3a76ac33-c05a-477c-b3eb-1aef192a1814 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:33.347366 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-3a76ac33-c05a-477c-b3eb-1aef192a1814 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:33.474621 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-3a76ac33-c05a-477c-b3eb-1aef192a1814 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae861c65a30450da54380e615298822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad26288dfab54e44b0ef67b8ee1277bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:24:33.481651 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-3a76ac33-c05a-477c-b3eb-1aef192a1814 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f" status: 200 len: 1315 microversion: 2.1 time: 0.147038 Nov 08 16:24:33.482241 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 797/1605] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:24:33 2021] GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:24:34.498810 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e19f988c-bad0-40aa-85b5-ed87e07e73a0 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:24:34.499448 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e19f988c-bad0-40aa-85b5-ed87e07e73a0 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:24:34.506160 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e19f988c-bad0-40aa-85b5-ed87e07e73a0 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:34.506601 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e19f988c-bad0-40aa-85b5-ed87e07e73a0 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:34.507363 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e19f988c-bad0-40aa-85b5-ed87e07e73a0 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:34.507790 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e19f988c-bad0-40aa-85b5-ed87e07e73a0 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:34.635326 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-e19f988c-bad0-40aa-85b5-ed87e07e73a0 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae861c65a30450da54380e615298822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad26288dfab54e44b0ef67b8ee1277bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:24:34.642484 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e19f988c-bad0-40aa-85b5-ed87e07e73a0 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f" status: 200 len: 1315 microversion: 2.1 time: 0.147650 Nov 08 16:24:34.643045 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 809/1606] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:24:34 2021] GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:24:35.659409 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5738cd74-1dd9-4bba-93af-05d658875d8b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:24:35.660009 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5738cd74-1dd9-4bba-93af-05d658875d8b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:24:35.666329 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5738cd74-1dd9-4bba-93af-05d658875d8b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:35.666768 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5738cd74-1dd9-4bba-93af-05d658875d8b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:35.667524 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5738cd74-1dd9-4bba-93af-05d658875d8b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:35.667949 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5738cd74-1dd9-4bba-93af-05d658875d8b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:35.795501 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-5738cd74-1dd9-4bba-93af-05d658875d8b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae861c65a30450da54380e615298822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad26288dfab54e44b0ef67b8ee1277bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:24:35.803170 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5738cd74-1dd9-4bba-93af-05d658875d8b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f" status: 200 len: 1315 microversion: 2.1 time: 0.147932 Nov 08 16:24:35.803725 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 798/1607] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:24:35 2021] GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:24:36.303476 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-4ec9672f-37be-4c5d-bf95-d6961f204dbd req-99888f46-d045-40c1-ac74-49cddf76e22a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "184e206e-40e2-43b8-bcd2-e7da4021a70f", "name": "network-vif-plugged", "status": "completed", "tag": "253b06d3-fdef-4152-8be6-3b6d31dc4c2a"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:24:36.305307 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:24:36.305307 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:24:36.312868 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-4ec9672f-37be-4c5d-bf95-d6961f204dbd req-99888f46-d045-40c1-ac74-49cddf76e22a service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:36.313310 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-4ec9672f-37be-4c5d-bf95-d6961f204dbd req-99888f46-d045-40c1-ac74-49cddf76e22a service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:36.324295 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-4ec9672f-37be-4c5d-bf95-d6961f204dbd req-99888f46-d045-40c1-ac74-49cddf76e22a service nova] Creating event network-vif-plugged:253b06d3-fdef-4152-8be6-3b6d31dc4c2a for instance 184e206e-40e2-43b8-bcd2-e7da4021a70f on hv-cinder-81618 Nov 08 16:24:36.329790 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-4ec9672f-37be-4c5d-bf95-d6961f204dbd req-99888f46-d045-40c1-ac74-49cddf76e22a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029926 Nov 08 16:24:36.330442 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 810/1608] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:24:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:24:36.820135 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-cd529a24-9fbf-435e-9d2c-5fd6ffb0363b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:24:36.820729 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-cd529a24-9fbf-435e-9d2c-5fd6ffb0363b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:24:36.826988 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cd529a24-9fbf-435e-9d2c-5fd6ffb0363b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:36.827436 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cd529a24-9fbf-435e-9d2c-5fd6ffb0363b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:36.828769 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cd529a24-9fbf-435e-9d2c-5fd6ffb0363b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:36.829202 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-cd529a24-9fbf-435e-9d2c-5fd6ffb0363b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:36.954929 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-cd529a24-9fbf-435e-9d2c-5fd6ffb0363b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae861c65a30450da54380e615298822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad26288dfab54e44b0ef67b8ee1277bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:24:36.961952 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-cd529a24-9fbf-435e-9d2c-5fd6ffb0363b tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f" status: 200 len: 1315 microversion: 2.1 time: 0.145414 Nov 08 16:24:36.962508 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 799/1609] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:24:36 2021] GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:24:37.979310 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-fce4c8ef-faa5-4b15-ac42-f8f269fcce56 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:24:37.980056 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fce4c8ef-faa5-4b15-ac42-f8f269fcce56 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:24:37.986595 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fce4c8ef-faa5-4b15-ac42-f8f269fcce56 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:37.987042 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fce4c8ef-faa5-4b15-ac42-f8f269fcce56 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:37.987836 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fce4c8ef-faa5-4b15-ac42-f8f269fcce56 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:37.988268 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fce4c8ef-faa5-4b15-ac42-f8f269fcce56 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:38.119325 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fce4c8ef-faa5-4b15-ac42-f8f269fcce56 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae861c65a30450da54380e615298822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad26288dfab54e44b0ef67b8ee1277bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:24:38.127578 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-fce4c8ef-faa5-4b15-ac42-f8f269fcce56 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f" status: 200 len: 1465 microversion: 2.1 time: 0.152746 Nov 08 16:24:38.128155 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 811/1610] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:24:37 2021] GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f => generated 1465 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:24:38.166073 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-d9ef8661-8cbb-4beb-9a26-4c4b4142d9cb tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:24:38.166566 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d9ef8661-8cbb-4beb-9a26-4c4b4142d9cb tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:24:38.173367 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d9ef8661-8cbb-4beb-9a26-4c4b4142d9cb tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:38.173834 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d9ef8661-8cbb-4beb-9a26-4c4b4142d9cb tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:38.174597 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d9ef8661-8cbb-4beb-9a26-4c4b4142d9cb tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:38.175029 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-d9ef8661-8cbb-4beb-9a26-4c4b4142d9cb tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:38.198575 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-d9ef8661-8cbb-4beb-9a26-4c4b4142d9cb tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] Going to try to terminate instance {{(pid=115524) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:24:38.271009 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-d9ef8661-8cbb-4beb-9a26-4c4b4142d9cb tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "DELETE /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f" status: 204 len: 0 microversion: 2.1 time: 0.108629 Nov 08 16:24:38.271767 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 800/1611] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:24:38 2021] DELETE /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:24:38.279718 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-0592efc1-0822-493a-979b-052aedbbe0e9 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:24:38.280321 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-0592efc1-0822-493a-979b-052aedbbe0e9 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:24:38.286080 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0592efc1-0822-493a-979b-052aedbbe0e9 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:38.286524 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0592efc1-0822-493a-979b-052aedbbe0e9 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:38.287289 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0592efc1-0822-493a-979b-052aedbbe0e9 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:38.287715 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-0592efc1-0822-493a-979b-052aedbbe0e9 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:38.413635 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-0592efc1-0822-493a-979b-052aedbbe0e9 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae861c65a30450da54380e615298822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad26288dfab54e44b0ef67b8ee1277bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:24:38.420770 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-0592efc1-0822-493a-979b-052aedbbe0e9 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f" status: 200 len: 1471 microversion: 2.1 time: 0.144697 Nov 08 16:24:38.421324 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 812/1612] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:24:38 2021] GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f => generated 1471 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:24:39.438257 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-52fbea11-c53f-42e6-a1b5-a2ee416519ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:24:39.438868 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-52fbea11-c53f-42e6-a1b5-a2ee416519ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:24:39.445038 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-52fbea11-c53f-42e6-a1b5-a2ee416519ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:39.445485 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-52fbea11-c53f-42e6-a1b5-a2ee416519ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:39.446279 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-52fbea11-c53f-42e6-a1b5-a2ee416519ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:39.446713 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-52fbea11-c53f-42e6-a1b5-a2ee416519ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:39.577032 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-52fbea11-c53f-42e6-a1b5-a2ee416519ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae861c65a30450da54380e615298822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad26288dfab54e44b0ef67b8ee1277bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:24:39.584986 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-52fbea11-c53f-42e6-a1b5-a2ee416519ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f" status: 200 len: 1471 microversion: 2.1 time: 0.150930 Nov 08 16:24:39.585556 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 801/1613] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:24:39 2021] GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:24:40.188972 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-0d2a5b07-4ed8-422f-97ea-7893990e4129 req-517f4006-6e15-40d3-970b-74e39c2487fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "184e206e-40e2-43b8-bcd2-e7da4021a70f", "name": "network-vif-deleted", "tag": "253b06d3-fdef-4152-8be6-3b6d31dc4c2a"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:24:40.190681 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:24:40.190681 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:24:40.198121 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-0d2a5b07-4ed8-422f-97ea-7893990e4129 req-517f4006-6e15-40d3-970b-74e39c2487fe service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:40.198849 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-0d2a5b07-4ed8-422f-97ea-7893990e4129 req-517f4006-6e15-40d3-970b-74e39c2487fe service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:40.211324 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-0d2a5b07-4ed8-422f-97ea-7893990e4129 req-517f4006-6e15-40d3-970b-74e39c2487fe service nova] Creating event network-vif-deleted:253b06d3-fdef-4152-8be6-3b6d31dc4c2a for instance 184e206e-40e2-43b8-bcd2-e7da4021a70f on hv-cinder-81618 Nov 08 16:24:40.217248 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-0d2a5b07-4ed8-422f-97ea-7893990e4129 req-517f4006-6e15-40d3-970b-74e39c2487fe service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032057 Nov 08 16:24:40.218113 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 813/1614] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:24:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:24:40.601540 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-520f048c-9399-4b3b-a367-092ecae3cf91 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:24:40.602246 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-520f048c-9399-4b3b-a367-092ecae3cf91 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:24:40.608862 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-520f048c-9399-4b3b-a367-092ecae3cf91 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:40.609344 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-520f048c-9399-4b3b-a367-092ecae3cf91 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:40.610384 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-520f048c-9399-4b3b-a367-092ecae3cf91 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:40.610996 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-520f048c-9399-4b3b-a367-092ecae3cf91 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:40.642840 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-520f048c-9399-4b3b-a367-092ecae3cf91 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:40.643288 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-520f048c-9399-4b3b-a367-092ecae3cf91 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:40.643738 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.objects.instance [None req-520f048c-9399-4b3b-a367-092ecae3cf91 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lazy-loading 'fault' on Instance uuid 184e206e-40e2-43b8-bcd2-e7da4021a70f {{(pid=115524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:24:40.682671 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-520f048c-9399-4b3b-a367-092ecae3cf91 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae861c65a30450da54380e615298822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad26288dfab54e44b0ef67b8ee1277bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:24:40.689187 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-520f048c-9399-4b3b-a367-092ecae3cf91 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f" status: 200 len: 1305 microversion: 2.1 time: 0.091374 Nov 08 16:24:40.689770 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 802/1615] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:24:40 2021] GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:24:41.707498 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d3b3b4d0-23b4-4552-88a9-4d5f38c7356c tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:24:41.708182 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-d3b3b4d0-23b4-4552-88a9-4d5f38c7356c tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] [instance: 184e206e-40e2-43b8-bcd2-e7da4021a70f] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:24:41.714150 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d3b3b4d0-23b4-4552-88a9-4d5f38c7356c tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:41.714593 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d3b3b4d0-23b4-4552-88a9-4d5f38c7356c tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:41.715350 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d3b3b4d0-23b4-4552-88a9-4d5f38c7356c tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:24:41.715781 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-d3b3b4d0-23b4-4552-88a9-4d5f38c7356c tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:24:41.728992 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.wsgi [None req-d3b3b4d0-23b4-4552-88a9-4d5f38c7356c tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] HTTP exception thrown: Instance 184e206e-40e2-43b8-bcd2-e7da4021a70f could not be found. Nov 08 16:24:41.729564 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-d3b3b4d0-23b4-4552-88a9-4d5f38c7356c tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Returning 404 to user: Instance 184e206e-40e2-43b8-bcd2-e7da4021a70f could not be found. {{(pid=115523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:24:41.730393 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-d3b3b4d0-23b4-4552-88a9-4d5f38c7356c tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f" status: 404 len: 111 microversion: 2.1 time: 0.027934 Nov 08 16:24:41.731013 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 814/1616] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:24:41 2021] GET /compute/v2.1/servers/184e206e-40e2-43b8-bcd2-e7da4021a70f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:25:12.158790 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-8f851fb7-daab-45fc-b4af-171d2c22b511 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:25:12.159318 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-8f851fb7-daab-45fc-b4af-171d2c22b511 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:12.165274 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8f851fb7-daab-45fc-b4af-171d2c22b511 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:12.165743 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8f851fb7-daab-45fc-b4af-171d2c22b511 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:12.166525 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8f851fb7-daab-45fc-b4af-171d2c22b511 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:12.166960 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-8f851fb7-daab-45fc-b4af-171d2c22b511 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:12.189277 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.objects.instance [None req-8f851fb7-daab-45fc-b4af-171d2c22b511 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lazy-loading 'flavor' on Instance uuid 8472eae0-c7a0-4a09-855d-0d96cce75e92 {{(pid=115524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:25:12.258013 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-8f851fb7-daab-45fc-b4af-171d2c22b511 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "POST /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92/action" status: 202 len: 0 microversion: 2.1 time: 0.103391 Nov 08 16:25:12.258584 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 803/1617] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:25:12 2021] POST /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:25:12.267991 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-fb42f0ac-5a1a-4a10-b0b4-182aef609004 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:12.268676 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-fb42f0ac-5a1a-4a10-b0b4-182aef609004 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:12.274780 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fb42f0ac-5a1a-4a10-b0b4-182aef609004 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:12.275279 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fb42f0ac-5a1a-4a10-b0b4-182aef609004 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:12.276074 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fb42f0ac-5a1a-4a10-b0b4-182aef609004 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:12.276497 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-fb42f0ac-5a1a-4a10-b0b4-182aef609004 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:12.410111 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-fb42f0ac-5a1a-4a10-b0b4-182aef609004 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:12.417345 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-fb42f0ac-5a1a-4a10-b0b4-182aef609004 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1571 microversion: 2.1 time: 0.154442 Nov 08 16:25:12.418007 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 815/1618] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:12 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:13.437204 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ca962962-01cf-47bd-9ace-f968bf949b66 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:13.437836 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ca962962-01cf-47bd-9ace-f968bf949b66 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:13.444536 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ca962962-01cf-47bd-9ace-f968bf949b66 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:13.444980 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ca962962-01cf-47bd-9ace-f968bf949b66 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:13.445792 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ca962962-01cf-47bd-9ace-f968bf949b66 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:13.446228 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ca962962-01cf-47bd-9ace-f968bf949b66 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:13.576933 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-ca962962-01cf-47bd-9ace-f968bf949b66 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:13.584293 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ca962962-01cf-47bd-9ace-f968bf949b66 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1571 microversion: 2.1 time: 0.151775 Nov 08 16:25:13.584862 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 804/1619] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:13 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:14.601396 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-ea75b9e2-1bfe-46be-9a56-fc5de5661225 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:14.602139 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-ea75b9e2-1bfe-46be-9a56-fc5de5661225 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:14.608213 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ea75b9e2-1bfe-46be-9a56-fc5de5661225 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:14.608653 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ea75b9e2-1bfe-46be-9a56-fc5de5661225 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:14.609413 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ea75b9e2-1bfe-46be-9a56-fc5de5661225 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:14.609889 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-ea75b9e2-1bfe-46be-9a56-fc5de5661225 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:14.738638 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-ea75b9e2-1bfe-46be-9a56-fc5de5661225 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:14.746050 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-ea75b9e2-1bfe-46be-9a56-fc5de5661225 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1571 microversion: 2.1 time: 0.148024 Nov 08 16:25:14.746610 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 816/1620] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:14 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1571 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:15.762798 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ff091c1c-305b-46f2-b9c5-a83fae7916d8 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:15.763422 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ff091c1c-305b-46f2-b9c5-a83fae7916d8 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:15.769893 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ff091c1c-305b-46f2-b9c5-a83fae7916d8 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:15.770332 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ff091c1c-305b-46f2-b9c5-a83fae7916d8 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:15.771088 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ff091c1c-305b-46f2-b9c5-a83fae7916d8 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:15.771511 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ff091c1c-305b-46f2-b9c5-a83fae7916d8 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:15.901054 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-ff091c1c-305b-46f2-b9c5-a83fae7916d8 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:15.908350 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ff091c1c-305b-46f2-b9c5-a83fae7916d8 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1571 microversion: 2.1 time: 0.149360 Nov 08 16:25:15.908907 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 805/1621] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:15 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1571 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:16.925053 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-6b16dd6c-02aa-47ac-aae1-37b90b344081 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:16.925657 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-6b16dd6c-02aa-47ac-aae1-37b90b344081 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:16.931487 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6b16dd6c-02aa-47ac-aae1-37b90b344081 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:16.931989 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6b16dd6c-02aa-47ac-aae1-37b90b344081 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:16.932748 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6b16dd6c-02aa-47ac-aae1-37b90b344081 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:16.933168 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-6b16dd6c-02aa-47ac-aae1-37b90b344081 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:17.059862 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-6b16dd6c-02aa-47ac-aae1-37b90b344081 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:17.067154 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-6b16dd6c-02aa-47ac-aae1-37b90b344081 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1571 microversion: 2.1 time: 0.145890 Nov 08 16:25:17.067713 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 817/1622] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:16 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1571 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:18.083713 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e1b812e4-8b4e-4d09-9053-3ceb0ebc40a0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:18.084746 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e1b812e4-8b4e-4d09-9053-3ceb0ebc40a0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:18.090511 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e1b812e4-8b4e-4d09-9053-3ceb0ebc40a0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:18.090952 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e1b812e4-8b4e-4d09-9053-3ceb0ebc40a0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:18.091710 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e1b812e4-8b4e-4d09-9053-3ceb0ebc40a0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:18.092135 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e1b812e4-8b4e-4d09-9053-3ceb0ebc40a0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:18.222752 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e1b812e4-8b4e-4d09-9053-3ceb0ebc40a0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:18.229922 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e1b812e4-8b4e-4d09-9053-3ceb0ebc40a0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1571 microversion: 2.1 time: 0.149900 Nov 08 16:25:18.230479 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 806/1623] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:18 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1571 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:19.246976 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-118a8c83-faea-44f8-918f-c2231737b0ac tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:19.247562 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-118a8c83-faea-44f8-918f-c2231737b0ac tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:19.254311 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-118a8c83-faea-44f8-918f-c2231737b0ac tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:19.254744 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-118a8c83-faea-44f8-918f-c2231737b0ac tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:19.255500 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-118a8c83-faea-44f8-918f-c2231737b0ac tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:19.255917 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-118a8c83-faea-44f8-918f-c2231737b0ac tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:19.382662 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-118a8c83-faea-44f8-918f-c2231737b0ac tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:19.389950 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-118a8c83-faea-44f8-918f-c2231737b0ac tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1571 microversion: 2.1 time: 0.146894 Nov 08 16:25:19.390512 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 818/1624] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:19 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1571 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:20.407214 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-262d316c-fab0-46c3-a755-b3393888645a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:20.407776 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-262d316c-fab0-46c3-a755-b3393888645a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:20.414756 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-262d316c-fab0-46c3-a755-b3393888645a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:20.415202 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-262d316c-fab0-46c3-a755-b3393888645a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:20.415975 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-262d316c-fab0-46c3-a755-b3393888645a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:20.416404 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-262d316c-fab0-46c3-a755-b3393888645a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:20.550105 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-262d316c-fab0-46c3-a755-b3393888645a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:20.557278 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-262d316c-fab0-46c3-a755-b3393888645a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1571 microversion: 2.1 time: 0.154335 Nov 08 16:25:20.557860 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 807/1625] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:20 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:21.574298 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-43dd608d-4752-4477-ab3e-b6625afad88b tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:21.574896 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-43dd608d-4752-4477-ab3e-b6625afad88b tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:21.581554 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-43dd608d-4752-4477-ab3e-b6625afad88b tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:21.582034 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-43dd608d-4752-4477-ab3e-b6625afad88b tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:21.582801 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-43dd608d-4752-4477-ab3e-b6625afad88b tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:21.583225 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-43dd608d-4752-4477-ab3e-b6625afad88b tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:21.710089 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-43dd608d-4752-4477-ab3e-b6625afad88b tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:21.717177 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-43dd608d-4752-4477-ab3e-b6625afad88b tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1571 microversion: 2.1 time: 0.146489 Nov 08 16:25:21.717841 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 819/1626] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:21 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1571 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:22.734216 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-23df0005-8ff5-462a-a3f9-eaf730baf8d1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:22.734846 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-23df0005-8ff5-462a-a3f9-eaf730baf8d1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:22.741131 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-23df0005-8ff5-462a-a3f9-eaf730baf8d1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:22.741598 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-23df0005-8ff5-462a-a3f9-eaf730baf8d1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:22.742415 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-23df0005-8ff5-462a-a3f9-eaf730baf8d1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:22.742848 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-23df0005-8ff5-462a-a3f9-eaf730baf8d1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:22.978634 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-23df0005-8ff5-462a-a3f9-eaf730baf8d1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:22.986373 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-23df0005-8ff5-462a-a3f9-eaf730baf8d1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1571 microversion: 2.1 time: 0.255890 Nov 08 16:25:22.986943 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 808/1627] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:22 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1571 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:24.003483 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-58a40239-5097-4e0c-b516-37b06788db8c tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:24.004089 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-58a40239-5097-4e0c-b516-37b06788db8c tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:24.010395 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-58a40239-5097-4e0c-b516-37b06788db8c tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:24.010836 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-58a40239-5097-4e0c-b516-37b06788db8c tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:24.011608 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-58a40239-5097-4e0c-b516-37b06788db8c tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:24.012036 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-58a40239-5097-4e0c-b516-37b06788db8c tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:24.143377 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-58a40239-5097-4e0c-b516-37b06788db8c tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:24.150743 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-58a40239-5097-4e0c-b516-37b06788db8c tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1571 microversion: 2.1 time: 0.150961 Nov 08 16:25:24.151301 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 820/1628] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:23 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:25.167590 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-73dc2816-cf2e-4877-9c6b-770cf28ce300 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:25.168304 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-73dc2816-cf2e-4877-9c6b-770cf28ce300 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:25.174801 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-73dc2816-cf2e-4877-9c6b-770cf28ce300 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:25.175406 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-73dc2816-cf2e-4877-9c6b-770cf28ce300 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:25.176211 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-73dc2816-cf2e-4877-9c6b-770cf28ce300 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:25.176638 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-73dc2816-cf2e-4877-9c6b-770cf28ce300 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:25.307756 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-73dc2816-cf2e-4877-9c6b-770cf28ce300 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:25.315000 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-73dc2816-cf2e-4877-9c6b-770cf28ce300 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1572 microversion: 2.1 time: 0.151229 Nov 08 16:25:25.315561 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 809/1629] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:25 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1572 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:25.331238 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-e43e674d-063c-4505-b1f5-3d74b39a0254 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:25:25.331799 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-e43e674d-063c-4505-b1f5-3d74b39a0254 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:25.337981 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e43e674d-063c-4505-b1f5-3d74b39a0254 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:25.338419 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e43e674d-063c-4505-b1f5-3d74b39a0254 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:25.339190 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e43e674d-063c-4505-b1f5-3d74b39a0254 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:25.339618 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-e43e674d-063c-4505-b1f5-3d74b39a0254 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:25.413645 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-e43e674d-063c-4505-b1f5-3d74b39a0254 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "POST /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92/action" status: 202 len: 0 microversion: 2.1 time: 0.086493 Nov 08 16:25:25.414273 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 821/1630] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Nov 8 16:25:25 2021] POST /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:25:25.422657 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-90809e9f-bd16-41ea-bcbe-63ce6923994f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:25.423262 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-90809e9f-bd16-41ea-bcbe-63ce6923994f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:25.428961 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-90809e9f-bd16-41ea-bcbe-63ce6923994f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:25.429406 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-90809e9f-bd16-41ea-bcbe-63ce6923994f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:25.430209 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-90809e9f-bd16-41ea-bcbe-63ce6923994f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:25.430644 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-90809e9f-bd16-41ea-bcbe-63ce6923994f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:25.559629 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-90809e9f-bd16-41ea-bcbe-63ce6923994f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:25.568069 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-90809e9f-bd16-41ea-bcbe-63ce6923994f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1520 microversion: 2.1 time: 0.149589 Nov 08 16:25:25.568632 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 810/1631] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:25 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:26.586061 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-4c9f6489-b4e0-4a4b-9dbd-e172122108b4 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:26.586664 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-4c9f6489-b4e0-4a4b-9dbd-e172122108b4 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:26.592454 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4c9f6489-b4e0-4a4b-9dbd-e172122108b4 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:26.593426 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4c9f6489-b4e0-4a4b-9dbd-e172122108b4 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:26.594290 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4c9f6489-b4e0-4a4b-9dbd-e172122108b4 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:26.594720 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-4c9f6489-b4e0-4a4b-9dbd-e172122108b4 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:26.730875 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-4c9f6489-b4e0-4a4b-9dbd-e172122108b4 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:26.738665 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-4c9f6489-b4e0-4a4b-9dbd-e172122108b4 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1578 microversion: 2.1 time: 0.156746 Nov 08 16:25:26.739227 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 822/1632] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:26 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:27.755980 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-a2d8188c-173e-4261-a73c-167331d8defd tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:27.756590 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-a2d8188c-173e-4261-a73c-167331d8defd tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:27.762916 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a2d8188c-173e-4261-a73c-167331d8defd tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:27.763365 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a2d8188c-173e-4261-a73c-167331d8defd tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:27.764140 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a2d8188c-173e-4261-a73c-167331d8defd tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:27.764577 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-a2d8188c-173e-4261-a73c-167331d8defd tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:27.891969 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-a2d8188c-173e-4261-a73c-167331d8defd tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:27.899156 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-a2d8188c-173e-4261-a73c-167331d8defd tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1578 microversion: 2.1 time: 0.146854 Nov 08 16:25:27.899721 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 811/1633] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:27 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1578 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:28.538422 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-d11b0619-7370-4105-8937-c5bb95a1e926 req-23b39d04-77ca-420b-b2c5-a0e1a8cb7f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "name": "network-vif-unplugged", "status": "completed", "tag": "e8c812be-3317-46f0-9044-f415824262be"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:25:28.539954 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:25:28.539954 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:25:28.547690 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-d11b0619-7370-4105-8937-c5bb95a1e926 req-23b39d04-77ca-420b-b2c5-a0e1a8cb7f02 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:28.548220 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-d11b0619-7370-4105-8937-c5bb95a1e926 req-23b39d04-77ca-420b-b2c5-a0e1a8cb7f02 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:28.560351 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-d11b0619-7370-4105-8937-c5bb95a1e926 req-23b39d04-77ca-420b-b2c5-a0e1a8cb7f02 service nova] Creating event network-vif-unplugged:e8c812be-3317-46f0-9044-f415824262be for instance 8472eae0-c7a0-4a09-855d-0d96cce75e92 on hv-cinder-81618 Nov 08 16:25:28.566314 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-d11b0619-7370-4105-8937-c5bb95a1e926 req-23b39d04-77ca-420b-b2c5-a0e1a8cb7f02 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031468 Nov 08 16:25:28.566893 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 823/1634] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:25:28 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:25:28.916385 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-899e34ee-a0c9-46c5-9554-c6d4cc2940b0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:28.916973 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-899e34ee-a0c9-46c5-9554-c6d4cc2940b0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:28.923191 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-899e34ee-a0c9-46c5-9554-c6d4cc2940b0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:28.923637 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-899e34ee-a0c9-46c5-9554-c6d4cc2940b0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:28.924403 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-899e34ee-a0c9-46c5-9554-c6d4cc2940b0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:28.924838 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-899e34ee-a0c9-46c5-9554-c6d4cc2940b0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:29.054631 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-899e34ee-a0c9-46c5-9554-c6d4cc2940b0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:29.061836 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-899e34ee-a0c9-46c5-9554-c6d4cc2940b0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1578 microversion: 2.1 time: 0.149138 Nov 08 16:25:29.062401 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 812/1635] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:28 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:30.080017 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-cc6750f3-a019-46cd-aafd-f3a2ee431d3e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:30.080757 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-cc6750f3-a019-46cd-aafd-f3a2ee431d3e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:30.087290 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cc6750f3-a019-46cd-aafd-f3a2ee431d3e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:30.087729 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cc6750f3-a019-46cd-aafd-f3a2ee431d3e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:30.088498 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cc6750f3-a019-46cd-aafd-f3a2ee431d3e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:30.088920 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-cc6750f3-a019-46cd-aafd-f3a2ee431d3e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:30.220722 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-cc6750f3-a019-46cd-aafd-f3a2ee431d3e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:30.228841 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-cc6750f3-a019-46cd-aafd-f3a2ee431d3e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1578 microversion: 2.1 time: 0.153403 Nov 08 16:25:30.229465 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 824/1636] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:30 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:31.245752 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-0027f2ae-af2d-47d0-b872-d1e69e82755a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:31.246565 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-0027f2ae-af2d-47d0-b872-d1e69e82755a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:31.253375 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0027f2ae-af2d-47d0-b872-d1e69e82755a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:31.253856 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0027f2ae-af2d-47d0-b872-d1e69e82755a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:31.254621 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0027f2ae-af2d-47d0-b872-d1e69e82755a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:31.255049 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-0027f2ae-af2d-47d0-b872-d1e69e82755a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:31.384970 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-0027f2ae-af2d-47d0-b872-d1e69e82755a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:31.392757 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-0027f2ae-af2d-47d0-b872-d1e69e82755a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1578 microversion: 2.1 time: 0.150773 Nov 08 16:25:31.393319 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 813/1637] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:31 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:32.410040 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-5e258a53-d42b-4ee2-940b-c527765742d1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:32.410638 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-5e258a53-d42b-4ee2-940b-c527765742d1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:32.417084 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5e258a53-d42b-4ee2-940b-c527765742d1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:32.417527 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5e258a53-d42b-4ee2-940b-c527765742d1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:32.418339 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5e258a53-d42b-4ee2-940b-c527765742d1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:32.418771 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-5e258a53-d42b-4ee2-940b-c527765742d1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:32.547212 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-5e258a53-d42b-4ee2-940b-c527765742d1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:32.554484 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-5e258a53-d42b-4ee2-940b-c527765742d1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1578 microversion: 2.1 time: 0.148068 Nov 08 16:25:32.555038 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 825/1638] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:32 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1578 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:25:33.571132 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-5f16c013-6846-4262-832d-b28e7f80dc66 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:33.571738 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-5f16c013-6846-4262-832d-b28e7f80dc66 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:33.577984 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5f16c013-6846-4262-832d-b28e7f80dc66 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:33.578432 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5f16c013-6846-4262-832d-b28e7f80dc66 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:33.579203 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5f16c013-6846-4262-832d-b28e7f80dc66 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:33.579637 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-5f16c013-6846-4262-832d-b28e7f80dc66 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:33.706698 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-5f16c013-6846-4262-832d-b28e7f80dc66 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:33.713994 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-5f16c013-6846-4262-832d-b28e7f80dc66 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1578 microversion: 2.1 time: 0.146588 Nov 08 16:25:33.714562 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 814/1639] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:33 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1578 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:34.730728 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-12b41ccb-89ed-4ce3-8624-6a34a212a8c0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:34.731254 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-12b41ccb-89ed-4ce3-8624-6a34a212a8c0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:34.737377 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-12b41ccb-89ed-4ce3-8624-6a34a212a8c0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:34.737839 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-12b41ccb-89ed-4ce3-8624-6a34a212a8c0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:34.738592 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-12b41ccb-89ed-4ce3-8624-6a34a212a8c0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:34.739026 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-12b41ccb-89ed-4ce3-8624-6a34a212a8c0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:34.865348 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-12b41ccb-89ed-4ce3-8624-6a34a212a8c0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:34.872675 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-12b41ccb-89ed-4ce3-8624-6a34a212a8c0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1578 microversion: 2.1 time: 0.145737 Nov 08 16:25:34.873241 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 826/1640] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:34 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1578 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:25:35.890040 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-e36f7747-46ae-431a-be41-fc1d50d097ae tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:25:35.890681 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-e36f7747-46ae-431a-be41-fc1d50d097ae tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:25:35.896964 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e36f7747-46ae-431a-be41-fc1d50d097ae tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:35.897441 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e36f7747-46ae-431a-be41-fc1d50d097ae tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:35.898245 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e36f7747-46ae-431a-be41-fc1d50d097ae tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:35.898677 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-e36f7747-46ae-431a-be41-fc1d50d097ae tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:36.032025 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-e36f7747-46ae-431a-be41-fc1d50d097ae tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:25:36.039300 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-e36f7747-46ae-431a-be41-fc1d50d097ae tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1565 microversion: 2.1 time: 0.153053 Nov 08 16:25:36.039858 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 815/1641] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:25:35 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:25:38.635050 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-f2aae8cc-684b-47a4-877b-d89d944f27f9 req-f1b6e4ff-8ccc-478f-a293-ae3e444428a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "name": "network-vif-plugged", "status": "completed", "tag": "e8c812be-3317-46f0-9044-f415824262be"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:25:38.636630 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:25:38.636630 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:25:38.644848 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-f2aae8cc-684b-47a4-877b-d89d944f27f9 req-f1b6e4ff-8ccc-478f-a293-ae3e444428a3 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:25:38.645289 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-f2aae8cc-684b-47a4-877b-d89d944f27f9 req-f1b6e4ff-8ccc-478f-a293-ae3e444428a3 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:25:38.656891 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-f2aae8cc-684b-47a4-877b-d89d944f27f9 req-f1b6e4ff-8ccc-478f-a293-ae3e444428a3 service nova] Creating event network-vif-plugged:e8c812be-3317-46f0-9044-f415824262be for instance 8472eae0-c7a0-4a09-855d-0d96cce75e92 on hv-cinder-81618 Nov 08 16:25:38.662241 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-f2aae8cc-684b-47a4-877b-d89d944f27f9 req-f1b6e4ff-8ccc-478f-a293-ae3e444428a3 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030869 Nov 08 16:25:38.662833 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 827/1642] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:25:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:26:26.468773 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 16:26:26.469461 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: Mon Nov 8 16:26:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 16:27:04.518895 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-bb566a2e-3058-4f1d-aee3-99d7a1a4c76e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:27:04.520016 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-bb566a2e-3058-4f1d-aee3-99d7a1a4c76e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:27:04.526574 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bb566a2e-3058-4f1d-aee3-99d7a1a4c76e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:27:04.527029 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bb566a2e-3058-4f1d-aee3-99d7a1a4c76e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:27:04.528433 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bb566a2e-3058-4f1d-aee3-99d7a1a4c76e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:27:04.528433 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-bb566a2e-3058-4f1d-aee3-99d7a1a4c76e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:27:04.553117 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-bb566a2e-3058-4f1d-aee3-99d7a1a4c76e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Going to try to terminate instance {{(pid=115524) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 16:27:04.633016 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-bb566a2e-3058-4f1d-aee3-99d7a1a4c76e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "DELETE /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 204 len: 0 microversion: 2.1 time: 0.118780 Nov 08 16:27:04.634474 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 816/1643] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Nov 8 16:27:04 2021] DELETE /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 16:27:04.642914 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-ab951a06-1db4-4f26-adb8-523d3393075d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:27:04.643942 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-ab951a06-1db4-4f26-adb8-523d3393075d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:27:04.650706 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ab951a06-1db4-4f26-adb8-523d3393075d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:27:04.651163 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ab951a06-1db4-4f26-adb8-523d3393075d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:27:04.652018 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ab951a06-1db4-4f26-adb8-523d3393075d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:27:04.652817 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-ab951a06-1db4-4f26-adb8-523d3393075d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:27:04.683890 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [req-70757a2f-49d3-419a-a86b-d3db23e9c4db req-f5a75995-6366-403e-bbad-5f0f68125832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "tag": "e8c812be-3317-46f0-9044-f415824262be"}]} {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:27:04.686069 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:27:04.686069 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: warnings.warn(msg) Nov 08 16:27:04.696874 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-70757a2f-49d3-419a-a86b-d3db23e9c4db req-f5a75995-6366-403e-bbad-5f0f68125832 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:27:04.697584 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [req-70757a2f-49d3-419a-a86b-d3db23e9c4db req-f5a75995-6366-403e-bbad-5f0f68125832 service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:27:04.708341 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.compute.server_external_events [req-70757a2f-49d3-419a-a86b-d3db23e9c4db req-f5a75995-6366-403e-bbad-5f0f68125832 service nova] Creating event network-changed:e8c812be-3317-46f0-9044-f415824262be for instance 8472eae0-c7a0-4a09-855d-0d96cce75e92 on hv-cinder-81618 Nov 08 16:27:04.713363 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [req-70757a2f-49d3-419a-a86b-d3db23e9c4db req-f5a75995-6366-403e-bbad-5f0f68125832 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196541 Nov 08 16:27:04.714213 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 828/1644] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:27:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 16:27:04.930504 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.policy [None req-ab951a06-1db4-4f26-adb8-523d3393075d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115524) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:27:04.937950 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-ab951a06-1db4-4f26-adb8-523d3393075d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1571 microversion: 2.1 time: 0.298750 Nov 08 16:27:04.938614 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 817/1645] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:27:04 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1571 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 16:27:05.956732 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-871a0906-93f3-4f4c-b2ee-b674304de2d8 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:27:05.957427 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-871a0906-93f3-4f4c-b2ee-b674304de2d8 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:27:05.963435 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-871a0906-93f3-4f4c-b2ee-b674304de2d8 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:27:05.963878 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-871a0906-93f3-4f4c-b2ee-b674304de2d8 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:27:05.964668 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-871a0906-93f3-4f4c-b2ee-b674304de2d8 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:27:05.965134 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-871a0906-93f3-4f4c-b2ee-b674304de2d8 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:27:06.147503 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-871a0906-93f3-4f4c-b2ee-b674304de2d8 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:27:06.154859 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-871a0906-93f3-4f4c-b2ee-b674304de2d8 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1452 microversion: 2.1 time: 0.202663 Nov 08 16:27:06.155448 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 829/1646] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:27:05 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1452 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:27:06.782301 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [req-9b5f9da7-da5b-45ec-8d80-8bcc7197efca req-de0bab67-d23d-4d73-856a-4cfdf609878d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "name": "network-vif-deleted", "tag": "e8c812be-3317-46f0-9044-f415824262be"}]} {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 16:27:06.784117 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 16:27:06.784117 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: warnings.warn(msg) Nov 08 16:27:06.793566 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-9b5f9da7-da5b-45ec-8d80-8bcc7197efca req-de0bab67-d23d-4d73-856a-4cfdf609878d service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:27:06.794041 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [req-9b5f9da7-da5b-45ec-8d80-8bcc7197efca req-de0bab67-d23d-4d73-856a-4cfdf609878d service nova] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:27:06.806122 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.compute.server_external_events [req-9b5f9da7-da5b-45ec-8d80-8bcc7197efca req-de0bab67-d23d-4d73-856a-4cfdf609878d service nova] Creating event network-vif-deleted:e8c812be-3317-46f0-9044-f415824262be for instance 8472eae0-c7a0-4a09-855d-0d96cce75e92 on hv-cinder-81618 Nov 08 16:27:06.811744 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [req-9b5f9da7-da5b-45ec-8d80-8bcc7197efca req-de0bab67-d23d-4d73-856a-4cfdf609878d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033132 Nov 08 16:27:06.812325 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 818/1647] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Nov 8 16:27:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 16:27:07.173700 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-bea1b591-d0f1-4960-a638-801ff398f87d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:27:07.174540 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.compute.api [None req-bea1b591-d0f1-4960-a638-801ff398f87d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115523) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:27:07.181448 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bea1b591-d0f1-4960-a638-801ff398f87d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:27:07.181929 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bea1b591-d0f1-4960-a638-801ff398f87d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:27:07.182698 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bea1b591-d0f1-4960-a638-801ff398f87d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:27:07.183116 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bea1b591-d0f1-4960-a638-801ff398f87d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:27:07.220290 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bea1b591-d0f1-4960-a638-801ff398f87d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:27:07.220723 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG oslo_concurrency.lockutils [None req-bea1b591-d0f1-4960-a638-801ff398f87d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:27:07.221160 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.objects.instance [None req-bea1b591-d0f1-4960-a638-801ff398f87d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lazy-loading 'fault' on Instance uuid 8472eae0-c7a0-4a09-855d-0d96cce75e92 {{(pid=115523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 16:27:07.261116 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.policy [None req-bea1b591-d0f1-4960-a638-801ff398f87d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fee92aabd2b546938fb603a624a63098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115523) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 16:27:07.268278 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-bea1b591-d0f1-4960-a638-801ff398f87d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 200 len: 1225 microversion: 2.1 time: 0.098863 Nov 08 16:27:07.268860 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 830/1648] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:27:07 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 16:27:08.285308 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-25198694-b382-418c-97b8-3f733b838cdb tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '>' {{(pid=115524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:27:08.286038 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.compute.api [None req-25198694-b382-418c-97b8-3f733b838cdb tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] [instance: 8472eae0-c7a0-4a09-855d-0d96cce75e92] Fetching instance by UUID {{(pid=115524) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 16:27:08.292478 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-25198694-b382-418c-97b8-3f733b838cdb tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:27:08.292921 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-25198694-b382-418c-97b8-3f733b838cdb tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:27:08.293905 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-25198694-b382-418c-97b8-3f733b838cdb tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:27:08.294338 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG oslo_concurrency.lockutils [None req-25198694-b382-418c-97b8-3f733b838cdb tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Lock "f1b83286-04a5-43a5-b4a1-4bd0edc3473b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:27:08.307540 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.wsgi [None req-25198694-b382-418c-97b8-3f733b838cdb tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] HTTP exception thrown: Instance 8472eae0-c7a0-4a09-855d-0d96cce75e92 could not be found. Nov 08 16:27:08.308123 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: DEBUG nova.api.openstack.wsgi [None req-25198694-b382-418c-97b8-3f733b838cdb tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Returning 404 to user: Instance 8472eae0-c7a0-4a09-855d-0d96cce75e92 could not be found. {{(pid=115524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 16:27:08.308943 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO nova.api.openstack.requestlog [None req-25198694-b382-418c-97b8-3f733b838cdb tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92" status: 404 len: 111 microversion: 2.1 time: 0.027725 Nov 08 16:27:08.309467 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: [pid: 115524|app: 0|req: 819/1649] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Nov 8 16:27:08 2021] GET /compute/v2.1/servers/8472eae0-c7a0-4a09-855d-0d96cce75e92 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 16:27:08.458666 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: DEBUG nova.api.openstack.wsgi [None req-f3ce0ca1-285c-48a7-9a06-cdc181b5dfaa tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling method '.version_select at 0x7f8c105568b0>' {{(pid=115523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 16:27:08.479957 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO nova.api.openstack.requestlog [None req-f3ce0ca1-285c-48a7-9a06-cdc181b5dfaa tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1532271561" status: 202 len: 0 microversion: 2.1 time: 0.024791 Nov 08 16:27:08.481190 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: [pid: 115523|app: 0|req: 831/1650] 10.222.0.37 () {58 vars in 1253 bytes} [Mon Nov 8 16:27:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1532271561 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 16:27:47.782897 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 16:27:47.783599 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: Mon Nov 8 16:27:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 16:27:55.174879 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 16:27:55.175368 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: Mon Nov 8 16:27:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 16:29:30.239593 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 16:29:30.240266 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: Mon Nov 8 16:29:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 16:29:46.486460 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 16:29:46.487016 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: Mon Nov 8 16:29:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 16:29:47.537093 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 16:29:47.537643 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: Mon Nov 8 16:29:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 16:29:50.443289 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 16:29:50.443818 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: Mon Nov 8 16:29:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 16:31:07.800319 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 16:31:07.801028 dv-cinder-816187-2-iscsi devstack@n-api.service[115523]: Mon Nov 8 16:31:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 16:31:15.192340 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 16:31:15.192867 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: Mon Nov 8 16:31:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 16:32:50.257282 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 16:32:50.257982 dv-cinder-816187-2-iscsi devstack@n-api.service[115524]: Mon Nov 8 16:32:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!